ff 



(19) 




(12) 



Europaiscttes Pa te n la tnt 
European Patent Offlco 
Office europten das brevets (11) 

EUROPEAN PATENT APPUCAT10N 




EP 0 901 289 A2 



(43) Date of pubficafon: 

ia03.1999 Bulletin 1999/10 

(21) Applkslkxinurrber: 98116684.6 

(22) Date of fiing: 03.09.1998 



(51) Ini a H04N 7/50. H04N 7/26. 
H04N 7/52 



(84) Designated Contracting States: 

ATBECHCYDE DKESH FRGBGRIEfrULU 
MCNLPTSE 

Designated Extension States: 
ALLTLVMKROSI 

(30) Priority: 03JI9.1997JP 238008/97 
25.09.1997 JP 25961 3S7 
01 .10.1997 JP 268468S7 
27.10.1997 JP 294487/97 

(71) Applicant: 

Matsushita Electronics Corporation 
Kadoma^, Osaka 571 -8501 (JP) 



(72) Irwentors: 

• liiliauctii, SeRchi 
NeyagaaraKshl, Osaio, 572-0018 (JP) 

• NIsMno^ Masakazu 
KaslMara^, Osaka, 582-0007 (JP) 

• Ftifwara, YUP 

NIshlnomiya-shI, Hyogo, 662-0872 (JP) 

• WBka,KazuMro 
MorlgucM-shI, Osaka, 570^1054 (JP) 

(74) Representative: 

GrOnecker. Kinkekley, 
Stocfcmair & Sctiwanhflusser 
Anwaltssozlelflt 
Maidinilianstrasse 58 
80638 MOnchen (DE) 



00 
CM 



(54) Apparatus for layered video oodbig 

(57) A video signal layering-enoodkig system 
according to ttie present inventiori has at least either a 
frequericy dtetrt)utk)n unit to jixige a frequerx^y cfetri^ 
tion in an input video sigrial or a rnotran ^jdgmerit ur)it to 
judge ttie motion of an input video s^nal. With this, 
encoding quantity control according to the characteriS' 
tics of the iriput vkleo sigrial can be performed kietiween 
layers. Also, with selection of encode modes and shar- 
ing ol a nriotion vector, the encoded data of a k)idirecltorh 
aBy predicted frame can t>e reduced and the encoding 
efficiency of a Iwgh resoluinn signal can tie increased. 

A digital txoadcast decoding system according to 
the present invention can readily cfisplay a pluralfty of 
broadcasting piogiain& on (fifferent channels onto a 
small screen within a main screen when digftal broad- 
casts are received, ty a decoding metliod in wfiich 
processing is easy, sinjcluially 6iri9)ie arculry. and soft- 
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In a dgftal broadcasting signal Storage according to 
the present invenlton, by Omning out DOT coefficients 
to reduce the quantify of data to be stored or to stow 
down ttie storing speed of reciuisde data and by additkxi 
of a video signal decoding sectton and vtoeo signal 
encoding section for encodnig video signals agaia the 

video signal fomnat in a storage medkffn can t)e foced as 
a single format 
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DBSCripllon 

BACKGROUND OF THE INVENTION 

1. Field of the invention 

[00011 The present Invention relates to an enoocfng 
quantity control m^hod and video signal encoding 
appanrtus for spatial ecalaUity proffle which is Nerar- 
chical coding in a spatial axis direction st and aw i Tert 
(ISO/lEC 138ia^) by the ISO Itoving Picture Ei^wrts 
Group (MPEQ. or for other Henchtoal codmg tech- 
niques, and also relates to the storing and deoocfing of 
video signals conpressedtTy the MPEQ stwidard. 

2. Description of the Prior Art 

[p002] Conventional video signal l^ering-enoxfng 
apparatus is based on the spatial scalabil^ profile 
which is hierarchical coding in a spetiai axis dnrection 
standartfzed (ISOHEC 1381d^ by the ISO Moving Pic- 
ture Experts G^roup (MPEQ). 
[00031 Ttie constitution and operation of the oonwen- 
tional video signal layering-erxxxfing apparatus wil 
hereinafter be descri>ed in reference to FIG. 22, which 
is a block diagram of the conventional video signal lay^ 
ering-erxxxling apparatus. 

[0004] As shown in RG. 22, an input video signal 
5000 is converted to a lower resolution video si^nl than 
the input video signal 5000 by a resoluiion coiwerter 
5001. 

[QOOq AmotiondetedorSOOastoreettieoulputofthe 
resolution converter 5001 (the encoded frame of the 
Input video si^ial 5000) in inage memory 5003 and 
also detects the motion of a macroblock urvt from the 
encoded frame and the previously encoded and 
decoded past refererx^ frame in the mnage memory 
5003. A motion compensator 5004 outputs a d f l fe i en ti a l 
signal between the video signal of the encoded frame 
and tNe reproduced video sigral of the reference frame 
detected by the motion detector 5002 in the unit of a 
macrobtodc A discrete cosine transform (DOT) unit 
5005 outputs the output (deferential si^raO of the 
motion compensator 5004 as DCT ooefficients for each 
blocK. A quantizer 5006 quantizes ttie DCT coeffidenis 
by a c^jantization step O-S;. a divisor enrptayed in quan- 
tization) specified by an encodmg rate controBer 5007 
and then outpUs the quantized DCT coeflioents. An 
inverse quantizer 5008 irwersely quantizes tfie DCT 
ooefficients quantized at the quantizer 5006 by the 
quantized quanfization step and ttien ou^jUs the 
inversely quantized DCT coel fi cicnl & . An iiMfse DCT 
(IDCT) unit 5009 oulpute the output of ttieinvefse quan- 
tizer 5006 as inverse IXn* coefficienl& A nnotion corn- 
pensator 5010 generates a reproduced video signal tff 
adcttig the output of the IDCT unit 5009 and the video 
signal of the reference frame wfiose motion was corrv 
pensated at the motion compervator 90O4. and then 
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Stores the reproduced video signal in the image mem- 
ory 5003. A variiA)l»4ength encoder 5011 variable- 
lenglh encodes the output of the quantizer S0O6 and a 
predetermined flag and then outpute the variabMenggi 
encoded video signal. A buffer 5012 stores the variable- 
lenglh encoded video si^ial temporarily and adgusts ttie 
oulpu speed of output data thereof. That is, the buffer 

5012 outputs a variable-length encoded video signal 
with low resolutioa 

PIOOSI The enoodfog rate controller 5007 determines 
tfie quanHzalion step of the encoded frame for each 
m acioblod i , based on me output (c^enfial signal) of 
the motion oonpen sa tor 5004, the encoded length of 
ttie encoded video signal, and the residual quantity 
inforrration on ttie buffer 5D12. 
[0007] On ttie other hand, the resolution converter 

5013 resolution converts the output (reproduced video 
signaO of Itie motion conpensator 5010, i.e., converts 
the resolution of the reproduced video signal to the 
same resolution as the nnput video signal 5000 and then 
stores it in image memory 5015. A motion detector 5014 
stores the encoded fnvne off the Input video signal 5000 
in the image memory 5015 and also detecte the motion 
of a macroblock mt from the encoded frame, the prm- 
ously encoded and decoded past reference frame (high 
resolution video signal) &n ttie image memory 5015, and 
from the reference frame ttiat is the video signal of the 
same time among ttie low resolution signals wtiich are 
ttie outputs of the resolution converter 5013. That is» in 
this motion detection, ttie motion detector 5014 com- 
piles the encoded frame of ttie irput video signal 5000 
wHh ttie above-mentioned past reference frame, ttie 
above-mentioned reference frame of the same time, 
and a reference frame generated by a confoination of 
ttiese, and ttien detects a reference frame with ttie high- 
est correlation In ttie urvt of a macrobiock. The refer- 
ence frame with ttie tugtiest oorrelatfon is output from 
ttie image memory 5015 to the motion oonpensator 
5016. 

[0008] Ihe motion compensator 5016 outputs a differ- 
ential signal between the vkieo signal of ttie encoded 
frame and ttie reproduced video signal of ttie reference 
frame delected liy ttie motion detector 5014 In ttie unit 
of a macrobtock. A DCT unit 5017 outputs ttie output 
(cfifferential signal) of the motion compmsator 5016 as 
IXrr coefficients for each t)kxie Aquantizer 5018 quan- 
tizes the DCT coefficients by a quantization step speci- 
fied by an encocing rate controller 5019 and ttien 
outputs ttie quantized DCT ooefficienls. An ffiverse 
er 5020 inversely (^jantizes ttie DCT coefTidents 
quantizied at ttie quantizer 501 8 by ttie quantized quan- 
tization step and ttien outputs ttie irwersely quantized 
DCT coefficients. An DCT unit 5012 outputs ttie output 
of the inverse quantizer 5020 as inverse DCT coeffi- 
dertSw A motion compensator 5022 generates a repro- 
duced video sigral by adding ttie output of ttie IDCT unit 
5021 and ttie reproduced video si^ial of the reference 
frame whose motion was compensated at the motion 
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ooiwpens a tDr 5016, and then stores the reproduced 
video signal bi ttie image memory 5D15. A variable- 
iengtti encoder 5023 va rio b io leng th encodes the output 
of the quantizBr 5018 and a pr e detemfined flag and 
then outputs the variable l en gt h encoded video tignal. 
A buffer 5024 stores the variable-length encoded video 
signal temporarAy and adiusts the ou^ speed of out- 
put data thereof . That is. the bufler 5024 outputs a vwf- 
able-length encoded video signal with high resohiion. 

[0009] The enoodtfig rate conlroHer 5019 delernvnes 
the quantization stop of the encoded frame for each 
macrobloLK based on the output (c B l fer enti al signap of 
the mo6on compensator 5016. the encoded length cl 
the encoded video signal, and the residual quantity of 
the buffer 5024. 

I901Q] In such a oonventior»l video signal layering- 
encocfng system, how€ver. ttie two encoding rate con- 
troOefS 5007 and 5019 control the encoding quantities 
incSviduany and independently so that the mean bit 
rates of the outputs t>ecome constant, respectively. For 
that reasoa in both the cases where the input video sig- 
nal 5000 contains and does not almost contain a large 
quantfty of hig^ frequency conponent Hie encodmg 
quantities are controlled in the same manner. More spe- 
cifically, the control far the enoodng quantity between 
layers is not entirely performed acconfing to the input 
video signal 5000. 

[0O11] fan addition, although encoding efficiency has 
t)een Improved in encodng a hi^ resolution video sig- 
nal by an increase in the number of reference images 
tor motion vector detection, an impn^^ement in the 
encoding efficiency by using a low resoMion signal 
more effectively tias not tieen performed. 
19012] Next, a conventional (fi^tal broadcast decoding 
apparatus vnl be descnbed in reference to FIG. 23, 
wtvch illustrates a block (fiagram of ttie conventional 
(figital broadcast decoding apparatus. 
I0O13] The conventionai digital broadcast decoding 
apparatus sfiown in FIG. 23 is a receiver tor a digital 
broadcast that employs video and audfo signals com- 
pressed and encoded by the MPEG standard. 
|q014] As shown in FIG. 23, a demodulaiing secSon 
6001 performs a predetermined demodufartion on a 
received dgital broadcast GOOO. thereby gevmting an 
MPEG streara A separating section 6002 separates 
video and audio si^iaJ compressed streams on a pre- 
deterrrtned ctiarmel from the generated MPEG stream. 
An aufio signal decodkig section 6003 decodes the 
audio signal oorrpressed stream and oi^Mts an audk> 
signal 6020. 

[0015] fen a video signal decodmg sec6on 6004. (1) a 
variablMenglh decoder 6005 vari o bi o l e ng th decodes 
ttie aforementioned video signei compressed stream 

and ttien outputs ttie nxition vector of a macrobtock urvt 

a quanfization step (i.e.. a cBvisor emptayed in quantiza- 
tion), and DOT coefficients, (2) an irwerse quantizer 
6006 Inversely quantizes ttie DOT ooefficienls t)y the 
quantization step decoded in ttie unit of a macroblock. 



(3) an IDCT unit 6007 outputs the inversely quantized 
OCT coefficients as IDCT coefficients^ (4) a motion 
oompersator 6008 reproduces a video sigrial trom ttie 
nxn* coefficients obtained by enploying a rnotion vec- 

5 tor In a macroblock unit and also from a signal stored in 
memory 6004. and (5) a memory controller 6010 con- 
trols ttie storage of ttie reproduced video signal in ttie 
memory 6004, the output of ttie video signal stored in 
the rnernory 6004 to the nriotion conperoator 6008. arid 

10 the output of the reproduced video signal, thereby out- 
putting a decoded video signal 6021. 

{001Q Such a oonventioraldlg^ broadcast decoding 
system reproduces only a video signal present on one 
diannel and, therefore, has ttie dsadvantage that a 

IS broadc a s ti ng progr am on adrfferent channel cannot be 
monitored on a smaU screen within a main screen at the 
sarne tirne. To achieve tt^ ttie system can t)e eqiipped 
wHhapluralifyof devices of ttie same structura But in 
such a case, ttiere is a disadvantage ttiat ttie cost is sig- 

20 nificantly increased. 

[0017] Next, a conventional digital Isroadcasting signal 
storage wBI 1)8 described in reference to FIG. 24, wNch 
mustrales a bfock diagram of the conventional digital 
broadcasting signal storaga 

25 [0018] The conventional cfigltal broadcast storage 
shown in Fia 24 a video tape recorder (ag. . D- VHS) 
for recording a cfigrtal txoadcast v^iich empfoys video 
and au£o signals compressed and encoded by ttie 
MPEG standard. 

30 10019) As stiown in FIG. 24, a demodulating section 
7001 performs a predetermmed demodulation on a 
received difiptal broadcast, thereby generating an 
MPEG stream. A separating section 7002 separates a 
transport stream (TS) on a predetermined channel from 

35 the MPEG streara A storing section 7003 stores the 
separated TS in a storage mediimi 7004. 
[0020] In such a conventional digftal broadcasting 8ig< 
nat storage, stor^ mecfia are restrained either by a 
large quantity of data to be stored or due to the fast stor- 

40 ing speed of requisite data. Furttiermore. since dHferent 
video si^ials m various formats (resdufion, frame fre- 
quency, et&) are present in storage media, Itiere is a 
protslem ttiat video signafo are dHficult to tiandla 

46 SUMMARY OF THE INVENTION 

[0021] It is an object of ttie present Irwention to pro- 
vide a video signal tayering-enoocfing ^rstem and a 
video si|^ial layeririg-ericoc^ng rnetfiod wtiich are capa- 

5a ble of controRing the quantity of encoding between lay- 
ers in aooordwice with an input video signal. 
100221 Another object of the irwenfion is to provide a 
digital t)roadcast decoding system^ a digital t)ro fl dc a s t 
decodfog method, and a video signal deoocSng system 

ss which are capable of monitorin g a pltraBty of broadcast- 
ing pr o gr an rtt (including a t)roadcasfing pro-am on a 
cfifferent channel) t^y sirrpler oorotitution ttian prior art 
[0029] Still another object of the invention is to provide 
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a dighal broadcasting signal storage 

casting signal storing method wW ch are <a^^ 

Ing. tor e«nplep the a tor e mentioncd probiem s that 

storage media are restrained either by a large quantity 

of data to be stored or due to the last storing speed of s 

requisite data and that since different video sign^ in 

various formats (resolution, frame trequenq^ eta) are 

present in storage medta. video signals are (Sfficuft to 

handia 

EINMI Ihe first vwenlion of the present iiwention is a 10 
method of layering arid encoding an input video signal 
on the basis of spatial resolution, oomprising: 

a first resolution transformation step qI generating a 
seooTKj video signal with low resolution from a first is 
video signal with high resolution which is said input 
video si^l; 

a first encocfing step of encoding said second video 
signal; 

a decoding step of decoding the encoded second so 
video signal; 

a second resolution transformation step of geneiat- 
Big a third video si^ial with the same hig^ resolu- 
tion as said frst video signal, based on the decoded 
video signal obtained by decocfing said second 26 
video signal; 

a second encoc^ step of enoodirig a video signal 
with the same high resolution as said first video sig- 
nal, obtained based on said first video si^ni and 
said third video signal: » 
a frequency oorrponent i n for ma ti on output 
step of outputfing iirtbrmation on a high frequency 
corrvxinent which Is included m said fvst video sig- 
nal or said second video signal; and 
an enoocBng quantity control step off oontroling an 
encoding rate at which said second video signal is 
encoded by said first encoding step and an encod- 
ing rate at which said first video signal is encoded 
by said second encoding stepi based on the ou^ 
hi^ freepjency component information. 

[0025] The second invention of the present irMsntion 
is an apparatus tor layering and encod in g a video signal 
on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resotution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video so 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution tr an sformation means to gener- 
ate a third video signal with the same resolution as ss 
said first video signal from the decoded video signal 
of said second video 81^; 
second enoodUig means to encode said first video 
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signal, based on a time axis correlation of the first 
video signal and based on said third video signal as 
a pradictBd video signal; 

frequency distrfoution measuring means to meas- 
ure a frequency distribution of said first video sig- 
nal; and 

encoc in g quantity control means to control an 
encoding rate at which said second video signal is 
encoded said first encoding meam and an 
encodtog rate at which said first video si^ial is 
encoded by said second encoding means, based 
on tie measured frequenqr (fislributlon. 

[gozq With this, for exanv)le, by having a frequency 
(fistrfoution judgment unit, encocing quantity control 
aocoRfing to a frequency conponent contained In an 
input video signal can be performed between layers. 
IQ027] The third invention of the present invention is 
an apparatus for layerlrig and ericoffing a video signal 
on the basis of spatial resolution, comprising: 

first resolution transformation mem to generate a 
second video signal with low resolution firom a first 
video si^ial with tia^ resolution which is an ftpiA 
video si^ial; 

first encoding means to encode said second video 
signal; 

decoding means to deoode the encoded second 
video signal; 

second resolution transformalion means to gener- 
ate a third video signal wHh the same resolution as 
said first video signal from the decoded video signal 
of said seoorvJ video signal; 
cifferential si^ial generating means to generate a 
fourth video signal whk^h is a difierential signal 
t)etween said first video signal arvi said third video 
signal; 

motion detection means to detect motion from said 
first video signal; 

second en co d ing means to encode said fourth 
video signal, based on the detected motion of said 
first video signal; 

frequency distribution measuring means to meas- 
ure a frequency (Sstribufion of s^ first video sig- 
nal; and 

BncodmQ quantity control means to control an 
encodffig rate at which said secorvl video signal is 
encoded by said first encodng n>eans and an 
ermxfng rate at wfiich said fourth video si^^ is 
encoded tsy said second encoding mear«, based 
on the measiffed frequency distribution. 

■0028] With this^ for exanple. by having a frequency 
dtelnbution judgment unit, encodmg quantity control 
aDoon&vg to a frec^iency componen t contained In an 
ir^ video signal can be performed l)etween layers in 
the hierarcfiical coding In which an erxxxfed signal at a 
high resolution component is a (fifferential signal with a 
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video signal reproduced mm a lovir vesofuiion oornpo- 
nent 

[P029] The fourth ir ww tto r io* the preseritinwi^ 
an apparatus tor layering and encoding a video signal 
on the basis of spatial resolution, compri si ng: s 



first resolution translbrniBtion meer« Id gerierai^ 
second video signal with iGw resolution froni a first 
video signal with high resolution which is an 
video signal; 

firet enoodmg means to encode said second video 

decoding means to decode the encoded second 
video signal; 

second resohjtion transformation weem to gener- 
ate a third video si^ral with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
nrotion detection means to delect inotion from said 
second video sifpnl; 

second encocfng means to encode said first video 
signal, twsed on a tImB axis cor r eiation of the first 
video signal and based on said third video signal as 
a precficted video signal; and 
ervxxfing quantity control means to control an 
encoding rate at which said second video signal is 
encoded by said first encoding means and an 
encocfing rate at which said first video signal is 
encoded by said second erxxxJing means, based 
on tfie detected motion of said second video signal. 

[0030] The fifth invention of the present invention is an 
apparatus for layering and enoodmg a video signal on 
the basis of spatial resolution, comprising: 

first resolution transformation rnearn to gerierate a 
second video signal with low resolutio n from a first 
video signal with high resolution which is an input 
video signal; 

first enco(ftng means to encode saki second video 
signal; 

decoding means to decode the encoded second 
videosignal; 

second resolution trarsformation means to gener- 
ate a tNrd video signal with the same resdufon as 
said first video si g n d fr om the decoded video signal 
of said second video signal; 
motion de t ection means to detect motion from said 
first video signal; 

second encodfeig means to encode said finst video 
signal, t»sed on a time axis correlation of the first 
video signal and based on said third video sigrtal as 
a precictBd video signal; and 
encodnng quantity control means to control an 
encode rate at which said second video signal is 
encoded by said first encocfing means and an 
encocfing rate at wNch said first video signal is 
encoded by said second encoding tnems, based 
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on the detected motion Of said first video signal. 

P031] With this, for example, by having a motion judg- 
ment unft, encoding quantity control according to the 
motion of an input video signal can be performed 
K>etween layers. 

[0032] The sixth invention of the present invention is 
an apparatus for layering and erxxxfirtg a video si£pial 
on the basis of spafel resolution, oonprising: 

first resolution transformation mear« to generate a 
second video signal with low resolution from a first 
video signal with high resdulion which is an input 
videosignal; 

first erwoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
videosignal; 

second resolution tr a nsformation means to gener* 
ate a tfurd video signal with the same resofotion as 



of said second video signal; 

ciHerenfial signal generating means to generate a 

fourth video signal which is a drfierential signal 

between said first video signal and said third video 

signal; 

motion detection means todetect motion from said 
first video si^ial; 

second encoding means to encode said fourth 
video si^Fial, t>ased on the detected motion of said 
fist video signal; arxJ 

encod i ng quantity control means to control an 
encoding rate at which said secorvl video signal is 
encoded tiy said first erxxxJing means and an 
encoding rate at which said fourth video signal Is 
encoded by said secorxJ encoding meare, tiased 
on the detected motion of said first video 
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[003^ With this, for exarTf)le,l)y having a rnotion^jdg'' 
ment unit, erxxxling c^jantity control accorcfing to the 
motion of an input video signal can t)e performed 
tMtween layers in the Nerarchical coding in which an 
encoded signal at a high resolution component is a drf- 
ierential signal with a video si^ial reproduced from a 
low resolution component 

IP034] The seventh invention of the present irwenlion 
is an apparatus for layering and encocfng a video signal 
on tfie basis of spatial resolufioa comprising: 

first resolution transformation meare to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
videosignal; 

fffst encoding means to encode said second video 
signal; 

decoding means to decode ttie encoded second 
videosignal: 

second resolution transformation means to gerter- 
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ate a itmd video si^iat with the safT>e resolution as 
said fifst vkJao signal from the decxxM 
of said second video signal; 

motion detection means to detect motion from said 
second video signal: 

second encoding means to encode said first video 
si^ial, tnsed on a tinne axis oorrelalion of the first 
video signal and tMsed on said ttM video signal as 
a predicted video signal; 

frequency distrfbulion measiring means to meas- 
ure a frequency dfetrlxifion of said fM video sig- 
nal;and 

encocfing c^iantity control means to control an 
encoding rate at which said second video signal is 
erxxxtod by said fwst ervxxfing means arvl m 
encocfing rate at which said first video signal is 
encoded ty said second encocing means* t>a5ed 
on the detected frequency (fistrftxjtion and the 
detected motion of said second video signal. 

[OOSq The eighth invention off ttie present invention is 
an apparatus for layering and encocfing a video signal 
on the t)a8ts of spatial resolution, compr i sing: 

first resolution transformation means to ger^erate a 
second video signal with low resolution from a first 
video signal with Ingh resolution which is an input 
video signal; 

first encxxSng means to enccxto said second video 

signal; 

decoding means to decode Ihe e n co d ed secorvi 
video signal; 

second resolution transformation means to gener- 
ate a third video signal wHh the s»ne resolution as 
said first video signal from the deoocied video signal 
of said second video signal; 
motion detection means to delect motion from said 
first video signal; 

secxind enccxing means to encxxfe said first video 
signal. t)esed on a time axis correlation of the first 
video signd and k)ased on said third video signal as 
a predkted video signal; 

freciuency distribution measuring means to meas- 
ure a frequenqr distrtxjtion off said first video sig- 
nal; and 

encoding c^uantity control means to control an 
encoding rate at which said seoorvl video signal is 
encoded by said first encoding means and an 
encoding rate at wfvch said first video signal is 
encoded by said second encocfing means, t>ased 
on the de t ec ted trequency dfetrtaution and the 
detected motion of said first video signal 



IPmq With this, lor exainple. by having a firequency 
(fistrixjtion judgprnent unit, encodvig quantity control 
accordffig to a frec^iency corrponent contained in an 
input video ss^nol can be performed between layers, 
and by having a motion judgment unit, enccxing c|uan- 
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tity control according to the motion Of an input video sig- 
nal can be performed t)elween tayere. 
19097] TTie ninth invention of the present invention is 
an apparatus for layering and encoding a video signal 
on the basis off spatial resolutioa oonprising: 

first resolution transfor ma tion means to generate a 
second video si^ial with low resolution from a first 
video signal wHh high resolution which to an input 
video signal; 

first encocfing means to encode said second video 
signal; 

decocfing means to decode the encoded second 
video sigrnl; 

second resolution transformation mear» to gener- 
ate a third video signal with the same resolution as 
sad first video si^ial from the decoded video signal 
of said second video si^ial; 
cfiflerential signal generating means to generate a 
fourth video signal which is a c^ential si^ 
between said first video signal and said third video 

signal; 

rnotion detection means to (letecl rncyfion from said 
first video signal; 

second enccxing means to ervxxje said fourth 
video signal, t>ased on ttie detected motion of said 
first video signal; 

freciuency cfistrixition measuring means to meas- 
ve a freciuency cfistnbution off said first video sig- 
nal; and 

encoding quantity control means to control an 
encocfing rata at which s^ second video signal is 
encoded by fust encocfing means and an 
encodbig rate at which said foifflh video signal is 
erxxxfed tjy said seccxid erxxxfing means, t>ased 
on the measured freciuency cfistributicin and the 
cJetected motion of said first video signal. 



so 
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I0O38] With this, for example, by having a frequency 
cfislrixiticxi judgment unit emxxfing C|uanti^ (xxitiol 
according to a frequency component (xmtained in an 
input video si^ial can be performed between layers in 
the hierarchical coding in which an encoded sigiial at a 
liigh resolution ccxnponent is a cfifferertfal signal with a 
video sigrul reproduced from a low resolution oorrpo- 
nent, and t)y having a motion jud^nent unit, encocfing 
ciuarrtity control acoorvfing to the motion of an input 
video signal can be performed l)etween layers in the 
hierarchical coc^ iri w^iich an encoded sigrval at a hi^ 
resolution oonpor^ent is a diffe r en ti al signal with a video 
signal reproducecl trom a kNV rescAition oorrfxjrienl 
100391 The seventeertfh invention off the present 
invention is a method of layering and encodmg an input 
video signal on tfw basis of spatial resolution, cornpris- 
ing: 

afirst resolution transformaticxi step of generating a 
second video signal with low resolution trom a first 
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video sigrial with high resokjtm 
video signal; 

a fflTBt enoodng step off encoding esid second video 



frame coding which employs onfy data wdhin said 
frame. (3) interframe foiwaid predictive oocfing 
which employs fKXward predk:tion in a line axis 
drection, and (4) inleitrame bicfirectiona] predictive 
coding wfMi enploys bidirectiorni predk:tion in the 
time axis cfiredion; 

wherein, when said interlrame txirectional predic- 
tive coding is performed by said second enoocSng 
means, only a motion vector oblMwd by inter! fame 
DKmecsonai preoiciion is enoooe o . 

[QMI] With this, for example, by encocing onfy a 
motion vector based on bidnrectional piedkAin between 
flames, a reduction in the quantity of enoodng becomes 
possible, so the encocfing efficiency of hi£^ resolution 



signals can be enhsuiced. 

IP042] The nineteenth invention of ttm present inven- 
tion is an appaiatus for layering and encoding a video 
signal on the basis of spat^ resolution, convirising: 
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a decodmg step of decoding the erKxxJed second s 
video signal; 

a second resolution translormation step of gerrarat- 
ing a tNid video si^raJ with the same high resolu- 
tion as said first video signal, based on the decoded 
video signal obtained by deoodbig said second 
video sispnal; and 

a second encoding step of encoding said first video 
signal, txised on a plurafty of encode modes; 
wfierein, vvhen in said second encodkig step said 
encoding is performed by employing an encode 
mode k)ased on k)icfirectional predk:tion in a time 
axis direction among said pluafty of encode 
modes, only information indkating which of said 
first video signal or said decoded video signal is uti- 
bed bjf tlie encoding in said first encoding step or 
encoding in said second encoding step is encoded. 

(P0401 Ttie eigfiteenth invention of the present invBTH 
tion is an apparatus for layering and encoding a video 
siyial on tiietwsis of spatel resolution, ix w ryrisifig: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution wtiich is an input 
videosignal; 

first ervoding means to encode said second video 
signal; 

decocting mecvis to decode the e n coded second 
videosignal; 

second resobjtion transfonration means to gener- 
ate a third video signal witti tie same resolution as 
said first video signal from the decoded video signal 
of said second video signal; and 
second encoding means to encode each frame of 
said first video signal tiy at least one of tfie encode 
modes among (1) spatial inter-resolution predictive 
coding wfiich employs predction in a speGal axis 
eirploying said tfird video signal, (2) inlra- 
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first resolution transformation mear« to generate a 
second video si^ial with low resohilion from a first 
video signal with Ngh resolution which is an irput 
videosignal; 

first encoding means Id encode each trame of said 
second video signal tiy either (1) intraframe coding 
which employs only data wHhbi said freune, (2) inter- 
frame forward predictive oocting wNch employs for- 
ward prediction in a time axis cKrection. or (3) 
interframe bidirectional predictive coding which 
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direction; 

decoding means to decode the erxxxied second 
videosignal; 

second resolution transformation means to gener- 
ate a tfwd video signal with the same resolution as 
said first video signal from ttie decoded video 
of said second video signal; ard 
second encocfing means to encode each frame of 
said first video signal by at least one of ttie encode 
modes among (1) spatial inter-resolution precfictive 
coding which erriploys predk:tion in a spatial axis 
direction employing said tiiird video signal, (2) intra- 
frame codng which errploys only data witiiin said 
frame, (3) interframe forward fxedidive coding 
wtilch enn|3loy8 forward prediction in a time axis 
dkecSon, and (4) irit e iframe bidirectional predicSve 
coding which erriploys tMtirectional prediction in ttie 
time axis direction; 

wfierein, when said interframe tMJirectional predic- 
tive coding is performed tiy said second encoding 
means, only a motion vector obtained tfjf interframe 
bidirectional precfiction is encoded. 

10043] Witt)this,fbreDcarff)le^inaddHiontoti)eafore- 
mentioned advantages, ttie encoded type of each frame 
tieoomes the same in encoding a low resolution signal 
and a high resolution signal, so it t>eoome6 possiaie to 
apply the motion vector of a low resolution signal wfien 
a high resolution signal is decoded, arxl consequently, 
error tolerance is increased. 

IP044] The twenty-fifth invention of the present Inven- 
tion is an apparatus for layering arxl encocing a video 
signal on ttie t>a5is of spatial resolution, comprising: 

first resolution transformafion means to generate a 
second video signal with low resolution from a first 
video signal with higlh resolution which is an input 
videosignal; 

first encocfing means to erxxxte said second video 

signal; 

decocting means to cJecode ttie encoded second 
signal; 
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860ona resounon tfansioifnaiion meonB v> gener* 
flte a tfiif d vidoo signal wHh fte saww resoiufafi as 
said fifst video signal froin tho dooodad 
of said second video signal; and 
second encoding means to encode each frame of 
said first video signal tsy at least one of tie encode 
modes among (1 ) spatial inter-reeolulion predtetive 
coding wttich eniptoys precfidion m a spaSai axis 
direction enploying said thiid video signal, (2) inka- 
frame oodmg wtnch erTf)loys only data wittwi said 
frame^ (3) inlerlirame fovwaid predkslive oodng 
wtiich employs forward predkition In a time aods 
direction, and (4) interframe t)kirectional predk;6ve 
coding whicti enploys t>icfirectiorial predk:tion in^ 
time axis cfirecbon; 

wlierein said second encoding mecms encodes 

of apre- 



deler mined nunter of liames tsy said upatiHi inter- 
resolution predictive codng alone. 

[0045] With thiSk for example, inliufcttiiie oocfng is not 
performed on hl^ resolution signals, so a reduction in 
the (yjantity of encoding t)eoomes possfcle, so that the 
encoding efficiency of high resolution signals can k>e 
entianced. 

(004$] The tvventy^sixth invention off tfie present inven- 
tk>n is an apparatus for layering aiKl erKsodmg a vk^ 
signal on the Imsis of spatial resolution, comprising: 

first resolution transformalion means to generate a 
second video signal with low resolutio n from a first 
video signal with high resohilion which is an irput 
video signal; 

first encoding means to encode said second 



decocfing means to decode the encoded second 
video signal; 

second resolution transformation wears to gener- 
ate a third video signal witti the same resolulion as 
said first video signal f loi ii tfie decoded video signal 
Or saiQ seoono vueo signal; 
second encod i ng means to ervxxSe each frame of 
said first video si^ial t)y at least one of the encode 
modes among (1) spatial vHer-resotution predk:tive 
coding wfiich emplcys precMion in a spatial axis 
(firection employing said third video signal, (2) intra- 
frame codmg which enploys only data wittnn said 
frame; (3) interframe fopMerd predtetivB oodbig 
which employs forward predction in a time axis 
directiorv and (4) ir4erframe tMfirectiortal predKlive 
couvig wnKVi einpioys DiQi^eciioriai preciciion n 
time axis direction; and 

motion vector detection means to detect a motion 
vector between frames of said first video signal; 
wf)erein said secorvj erxxxin g means performs 
encocfing by employing the motion vector detected 
liy said motion vador det e ction meens^ and said 
first erKXXing means p ertorm B encod k ig bf 



employing a motion vector obtained tsy muK|plying 
ttie motion vector de te cted at said motion vector 
detection means by a predetermined nuntier. 

5 [0O47I With this, for example, as the motion vector 
detection of tfie frame of a high resoMion signal is not 
perlsrmed, imraR circuit size can t>e reduced, and as 
ttie motion vector is not encoded, the encoding effi- 
ciency of tiigh reeolution eignats can tie enhanced. 

vo |0O4q Ihe t wo nt y e i ghth invention of the present 
invention is a metfKXf of layering and encoding an input 
video signal on the basis of spatial resduten, oonpris* 
ing: 

IS afirstresduliontrBrisforniationstepof gerierBtinga 
second video sigral wfth low resohition from a first 
video signal with high resolution wti'ch is said input 
videosignal; 

a first encoding step of encoding said second video 
20 signal; 

a decoding step of decoding the encoded second 
videosignal; 

a second resolution transformation step of generat- 
ing a tlM video signal with the same fug^ resolu- 
25 tk)n as sad first video signal, based on tf>e decoded 
video signal obtained by decoding said second 
videosignal; 

a dtfierential signed generation step of computing a 
data dfference between frames cf said first and 

30 Ihffd video signals which correspond with each 
ottier and genwErting a ( fi ftweiit ial signal: 
a tjand dhficfing step of cividing tfie generated differ- 
ential signal into a pturaTity of predetermined t)ands 
and generating a barvl dividing si^uU; arxl 

36 a second encoding step of encoding tfie generated 
band dividng signal. 

PXMSI The twenty-ninth of the present invention is an 
apparatus tor layer^ and ericocing an input video sig- 
40 nal on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is said input 
45 videosignal; 

first encoding means to encode said second video 
signal; 

decoding means to decode tfw encoded second 
videosignal; 

50 second resolution transionnation means to gener- 
ate a third video signal vMth the same high resolu- 
tion as said first video signal, based on tfte decoded 
video signal obl^ned by deoocBiig said second 
video si^ial; 

ss dHferertial signal generation nneans to compkAe a 
data differ e nce between frames of said first and 
third video signals wtnch correspond with each 
other and generate a differential signal; 
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band (fivKfirig means to dMie the generate 
enlial signal by said daterential signal geneialion 
means M) a plurafily of predelennined bands and 
genefate a band dividing signal; and 
second enoocfing means encode said band cRvid- s 
ing signal generated by said band divicRng means. 



on a predetermined channel; 

an aixSo signal decodung section to decode the 
separated audk) signal compressed stream present 



[0050] With this, for example. dHferentencoc&ig meth- 
ods are employed m a tow resoiulion signal and a high 
resolufion signal, so if botti signals are combined to 
together, a resolution signal can be encoded so 
that it is effective and therefore the picture quafi^ 0^ 
Ngh resoMion si^ can be i m proved. 
PI061] Ihethirti^ invention of the present invention 
is a cfigitai broadcast decocfing method of decoding a is 
broadcasting sl^ial compressed ttie Momq Picture 
Experts Group (MPEG) standaid and muttiple)ffid. com- 
prising: 

a dernodiialion step of perforn*tg a predetermined 20 
demodulation on said broadcasting sigrad; 
a separation step of separating tlie demodulated 
l)n)adcasting siptal into a video signal compressed 
stream and an aucfio signal conrpressed stream on 
a first channel; ^ 
a first video si^ decocfing step of decocfing the 
separated video si£^ conrpressed stream present 
on said first cfiannel; 

a first audio signal decoding step of decoding the 
separated audio signal oonpressed stream present 90 
on said firsi channel; and 

a second video signal decoding step of decoding a 
video signal oonnpressed stream present on a sec- 
ond cfiannel different from said fHst cfiannel; 
wfierein in said second video signal decoding step^ as 
(1) the video signal compressed stream on said 
second channel is decoded, (2) a motion vector^ 
and a DC component in DCT ooefUcienls are 
eDcHaded, or a DC conponen t and some of DCT 
ooafficienis eocduding the DC coinponent are 40 
eKtracted, mJ (3) based on tfie eodracted confer^ 
said second video signal is decoded. 

[0052] The thtrty^irst invention of the present inven- 
tion is a digital broadcast deoocfing apparatus for deood- 45 
ing a txoadcasting siganal wfvch is generated from a 
video signal and an audk) signal wfiich are corrpressed 
by the lyloving Picture Experts Group (MPEGf) standard, 
muttipieoced arvt modulated, oonfirising: 

50 

a demodulating section to perlbrm a predetermsied 
demodulalion on said digital tmadcasting sigrial; 
a separating section to separate ttte demodulaled 
broadcasting signal into a video signal conpressed 
streem and an audto signal conpressed stream on bs 
at least one channel by releasing said muHpleDdng; 
a first video signal decocfing section to decode the 
separated video signal conpressed stream present 



on said predetermiried ctiannel; 
a second video signal decocfing section to decode a 

video signal compressed stream present on a 
channel other than said predetermined channel 
and to output the decoded signal; and 
a video signal overtaying section to overlay a video 
signd oulput of said second video signal decodsng 
sectoi at a predetemnined position on a video sig- 
nal output of said first video signal decoding section 

and to output tie overlaid signal: 

wherein said second video signal decoding section 

has: 

a vaiabie-length decoder which (1) variable-length 
decodes said video signal compressed stream, (2) 
GKtracts a motion vector and a DC component, or 
C3) exiracte a quantization step when said DC com- 
ponent is quantized, the quantization step being a 
dMsor enptoyed in the quantization; 
inverse dHferential pulse code nnodulation (DPCM) 

iMiH to perform Inveree DPCM only when DPCM 
has been perfoaned on said DC component; 
an diverse quantizer to perform inverse quantiza- 
tion only when said DC component has been quan- 



memory to store ttie decoded video si^ial; 
a motion compensator to conyen^te motion by 
employing botii a video signal compensated and 
decoded after said motion vector has been trans- 
formed by a predetemvned transfarmatio n and a 
video signal stored in said memory; and 
a memory controller to control writing of date to said 
memory and readffig of date from said memory 

(DOS?] With this, for example, a broadcasting pro-am 
on a different channel can be reacfiy displayed on a 
smai saeen within a main screen when a digitai kxoad- 

cast is received. 

lOOS^q The thirty-thlid invention of the present inven- 
tion is a dtgOal broadcast decoding apparatus for decod- 
ing a broadcasting siganal wftich is generated from a 
video sigmd and an aucfio signal which are compressed 
by the Moving Picture Experts Group (MPEG) standard, 
multipleKed and modulated, comprising: 

a demodulating section to perform a predetermined 
demodulation on said digil^ broadcasting stgpsd : 
a separating section to separate tfie demodiiated 
broadcasting signal into a video sigrtal compressed 
stream and an audio signal compr e s s ed stream on 
al least one channel by releasing said rnJliileDdng; 
a firsI video signal deoxfing section to decode the 
separated video signal compressed stream present 
on a prede te rmined cfiafwiel; 
an audio signal decoding section to decode tfie 
separated audio signal compressed stream present 
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on said predetermined channel; 
aeeoond video signal deooding eeqiion to deoodea 
video signal compressed stream prosent on a 
chamei other than said predetenmmed channel 
and to output the decoded signal; and 
a video signdl Gvertaying section to overlay a video 
signal oUpU of said second video sii^ decoding 
section at a predeternrwied position on a video sig- 
nal ou^ of sad first video signal decoding sectm 

and to output the overlaid signd; 

wherein said second video signal decoding section 

has: 

a variak)le-length decoder wtuch (1 ) variable-length 
decodes said video signal oonpressed stream and 
(2) extracts a motion vector, a (^antization step 
which is a cfivisor employed In c^jantizalion, and M 
X N DCT ooefficiems consisting of M coefficients in 
a hortaEontal direclion (where M is a natural number 
from 1 to 8) and N coefficients in a vertical direction 
(where N is a natural numl)er from 1 to 8}; 
an inveise quantizer lo quantize said M x N DCT 
coefficients Irwersety; 

memory to store the decoded video signal; 
a motion compensator to condensate motion by 
enrploying both a video signal compensated and 
decoded after said motion vector has been trans- 
formed in horizontal and vertical directions by a pre- 
determined transformation and a video signal 
stored in said memory; and 
a memory oomroBer to oonliol wrWng of data to said 
memory and reading of data from said memory. 



[0065] WHh this, fcx example, a broadcastnig program 
on a different channel can be readily cfispt^red on a 
smal screen within a main saeen wfien a digital txoad- 

cast is received. 

[0066] The fbrti^ invention of the present invention 
isa< 









Lit 







ing and storing a broadcasting ^gnal oornpressed by 
the Moving Picture Experts Cteup (MPEG) standard 
and rnuHlpleoied. ooinprising the steps of: 

receiving said broadcasting signal and perfoming a 

predetermUied demodulation; 

separating a video sign£d compressed stream from 

the demodulated broadcasting sigrud; 

decoding the separated video signal compressed 

stream; 

based on a predetennined flag in the decoded 
stream. andAv based on a predetermined motion 
vector and predetermined DCT uoefTuJeiitb in the 
decoded streara (1) con v erting various toinate in 
said decoded stream to a predetermined formel 
andA>r ^) reducing tfie cbta amount of smd 
decoded stream, and then (3) enoodbig said 
decoded stream; and 

storing the encoded stream in a predetennined 
stOTEige medium. 



IP057] The forty-first invention of the present invention 
is a digitBl bioadcasfing signal storage for storing a 
broadcast compressed by the Moving Picture Experts 
&oup (MPEG) standard, conprising: 

5 

a demodulaling section to perform a predetermined 
demodUation on a digital broadcast which is broad- 
casted t)y corrpressffig a video signal and an audio 
si^iai by the MPEQ standard and performing pre- 
10 determined multiplexing and modulation on the 
video and audto signals; 

a separating section to separate video and aucfio 
signal oonpres s ed streams on a pred^ermined 
channel by releasing said predetermined multiplex- 

15 ing; 

memory to stae tfte separated audio signal com- 
pressed stream terrporanly ; 
a vari^e^englh decoder to perform variable- 
length decoding on the separated video signal conv 

20 pressed stream and to select various flags, motion 
vectora* and a predetermined number of DCT coef- 
ficients (M coelficienls In a horizontal direction 
where M is a natural number from 1 to 8 and N coef- 
ficients in a vertical direction where N is a natural 

25 nurTt>ertrom1 to8); 

a vari^e-length encoder to perform variable- 
length encocfing on the selected various flags and 
rnotion vectors, tiy performing a predetenrnsned flag 
transformation on the selected various flags and 

30 dso performing a motion vector transformation on 
the selected motion vectors; 
a multfpleodng section to multipfex the variable- 
length encoded video signal data and said audio 
signal compressed stream; and 

36 a storage section to store the nrvHipleKed data in a 
predetermined storage medium. 

[0058] With this, for exarrple. either by thinnffig out 
DCT coefTcients to reduce the quantity of data to be 
40 stored or to stow down the storing speed of requisito 
data, or by encoding DCn" coefficients agaia even inihe 
case where video signals in various fonnat5 (resolution. 

frame frequency, eto.) are input the video signals can 
t>e stored in a storage medium as a single format 
45 100591 The forty-second invention of the presort 
invention is a digitol broadcasting signal storage for 
storing a broadcast oonpressed tsy the Moving Picture 
Experts Group (MPEQ) standard, comprising: 

so a demodulaling section to perform a predetermmed 
demodulation on a digital broadcast which is broad- 
casted t>y conpressing a video signal and an audto 
signal by the MPEQ standard and performing pre- 
detennined multiplexing and modulation on the 

S6 video and audk) signals; 

a separating section to separate video arxJ aucfo 
signal corr|)ressed streams on a predetermmed 
channel by releasing said predetermined muHiplex- 
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ing; 

memory to store the separated audo Gifpai oonrv 
pressed stream tenfXKarily; 
a variabl&4ength decoder which variabMength 
decodes the separated video signd compr ess ed 
stream and selects various flaos^ (1) periorms a 
motion vector transform a tion wlien a motion vector 
has tieen determined in a frame unA, (SQ converts 
the motion vector to a frame unit by a predeter- 
mined approodmalion method when the motion vec- 
tor has been determined in a field unit C^) selects 
only a predetermined nuni>er off DGT ooeificienis 
(M coefficients in a horizontal direction and N coef- 
ficients in a vertical <firecton where M and N are a 
naturd nurriw from 1 to 8) wt)en DCT coefficients 
have been determined in a frame unit, and (4) 
deletes one group of OCT coefficients and selects 
only a predetermined number of DCT coefficients 
CM coef fi cients in a horizontal direction and K ooef- 
ficienls in a vertical d rection wtiere M and K are a 
natural nunt)er from 1 to 8) when DGT ooefficienis 
have t>een deterrraned in a field iHvt; 
a variable-length encoder to perform variable- 
lenglh enoocfing on the selected various flags, 
motion vectors, and DCT coefficients by performing 
a predetermined flag translbrmafon on the 
selected yaxtoa& flags, motion vectors, and DCT 
ooeffidentB: 

a multilpleDdng section to multipIeK tfie ^mable- 
length encoded video signal data and said audio 
signal corrpressed stream; and 
a storage section to store the mult9)leNed data in a 
predeterrnined storage rnediunn. 

[0060] With this, for exanrple, eitfYer by tNnning out 
DCT coefficients to reduce the cpontity of data to be 
stored or to slow down the storing speed of reqinsite 
data, a by encoding DGT ooefficienis again, even in the 
case where video signals in various formals (resoMion, 
frame frequency, eto.) are input, tfie video signals can 
be stored in a storage medium as a single formal 
[0061] The forty-third vwenlion o4 tf>e present inverh 
tion is an apparatus for reproducing a video sigiul and 
an audio signal, oonrprising: 



a reproducing section to reproduce data stored in 
tfie digital broadcasting signal storage as set ferth 
in said fbrtyfirst or said forty-eeoond invonlion; 
a separating section to separate tlie reproduced 
data into video and audto signal compre sse d 
streams; 

a video signal deoodbig secten to decode the sep- 
arated video signal conpressed stream; and 
an audio signal decoifing section to decode ttte 
separated aucio sigial coinpr esse d stream; 
wfierein the video signal decoding section has: 
a variabt o le n g th decoder to perform wariable- 
lenglh decoding on said video signal cornpressed 
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stream; 

an inverse quantizer to quantize the variable-lenglh 
decoded data inversely; 

an IDCTunittopertorm an inverse M xNorMxK 
DCT (where M. N, and K are a natural number from 
1 to on the inversely quantized data; 
memory to store the deooded video signal; 
a motion compensator to oonpensate motion by 
enploying both a video signal deooded whh a 
motion vector and a video signd stored in said 
memory; and 
amemory* 
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memory and reading of data from said memory. 

{P062] With this, for example, by thinning out DCT 
coefficients, the quantity off data to be stored can be 
reduced and the speed off requmite data can be slowed 

dowa 

ID063I the fdrty4our1h invention of the present inven- 
tion is a digital broadcasltog signal storage for storing a 
broadcast compressed by the Moving Picture Experts 
Qmp (MPEQ) standard, oomprising: 

a demodulating section to perform a predetermined 
demodulation on a Gfigital broadcast which is broad- 
casted by conpresstng a video signal arxJ an audio 
signal by the standard and performing pre- 
determined multpleDdng and modulation on the 
video and audto signais; 

a separating section to separate video and audio 
9gnsA compressed streams on a predetermined 
channel by releasing said predeterrnined rnultiplex- 

»ng; 

memory to store the separated audio signal com- 
pressed stream temporarily; 
a video signal decocfing section to decode the sep- 
arated video signal oonpressed stream; 
a video signal compression section to congress a 
video signal which is tfie ou^ of said video signal 
decoding section; 

a multi|)le9dng section to multiplex the video sign^ 
compressed stream oonrpressed at said video sig- 
nal conpression section and said audio signal com- 
pressed stream; and 

a storage section to store the miitiplexed data in a 
predetermined storage medium; 
wfierein said video signal decoding section has: 
a variable-length decxxtor to perform variable- 
lenglh decoding on said video signal compres s ed 
stream; 

an inverse quantizer to quantize tfie variable4ength 
deooded data irwersely; 

an IDCT unit to perform an inverse DCT on tfie 

inversely quantized data; 

memory to store tfie decoded video signal; 

a motion compensator to oonpensate motion by 

employing txith a video signal deooded with a 

motion vector and a video signal stored in said 
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memory; and 

a memory oontroBer to ooritiol wrfting of 

memory and reading of data from said memory; 

and 

wherein said video 8igriaioorTpre68ionseclX)n has: s 
a fiterHig unit to cfunge resolution of a video signal 
by performing a predatermned filering operation 
on a reproduced video signal of a video signtf com- 
pressed stream dimg a digM broadcas t, Ihe 
reproduced video signal being the output of the ro 
video signal deoocfing section; 
a (fifferential signal genevator to generate a differ- 
enti^ signal of the fitered repvoduoed video signal 
by employing said motion vector present ii said 
video sigrialoonpr e ssed stream which is tfie output is 
of said video signal decoding section; 
a DOT urvt to peribnn DCT on the d i ffe r en t ia l sig- 
nal; 

a quantizer to quantize data after DCT by employ- 
hg said various flags which are input to the quan- 20 
lizer; a variable-length encoder to vanable4ength 
ervxxle the output of said quantizer; and said video 
signal compression section outputs a new video 
signal compressed stream. 

2S 

IP064] With IMS, for eoanple, either by iNnning out 
DCT coefficients to reduce the quantity of data to be 
stored or to slow down the storing speed of requsAe 
data, or by enoocfing CXTT ooefficientB again, even in tfie 
case where video signals in various formats (resolution, 30 
frame frequency, eto.) are mput, the video sigrtals can 
be stored in a storage medium as a single format 

BRIEF DESCRIPTION OF THE DRAWINGS 

56 

[006SI The abcve and other obieds and adiontagee 
win become apparent from the following detailed 
description when read in coniunction with the aooonrpa- 
nying drawings wherein: 

40 

FIG. 1 isabiocKdiagramofavideosi^iall^fering- 

erKXXing apparatus (system) according to a fnst 

embocfiment of the present invertion; 

FIG. 2 is a blocic dtagram of a video signal layering- 

encoding apparatus (system) aooordnig to a seo- 46 

ond embodfanent of tlie present inversion; 

FIG. 3 is a block cfiagram of a video signaliayering- 

enooding apparatus(system) according to a thsd 

eiiixxfiment of Hie present invention; 

FIG. 4 is a blocl(di^rBni of a video signal layering- 5d 

encoding apparatus (system) accord ing to a fourth 

ennbocfiment of the present invention; 

FIG. 5 is a biocic (fiagram of a video signal layering- 

encoding apparatus (system) acoonfng to a fifth 

emtxxfiment of the present inversion; ss 

FIG. 6 is a blodc diagram of a video signal layering- 

encoding apparatus(8ystem) according to a sixth 

emtxxfiment of tfie present invention; 



FIQl 7 isa blOGkcfiagramof a video signal layering- 
enoodtoig appaiadusCsystem) according to a sev- 
entt) errtedmnt Of tfie present invention; 

FIG. 8 is a blodc diagram of a video signal layering- 
encocfing apparatus (system) according to an 
eighth entxxlimerit of the presem invention arid a 
nintfi errtafiment of the present invention; 
FIG. 9 is a block dtagram of a video signal layering- 
encoding apperalus(system) aocoiding to a 13lh 
cmb o d te nent of the present Inventfory 
FIG. 10 is a block diagram of a vkteo signal layer- 
ing-encoding apparatus(system) accortfing to an 
14th errt)odiment of the present invention; 
FIGl 11 isat)tock(fiagrBmofatiratdigitalt)roadcast 
deoodmg apparBtus(8ystem) according to a 15th 
enfoodiment of the present inventkxi; 
FIG. l2i8abtoGkdiagramof affiratdigitalbroadcast 
deoodffig apparatus(system) aocoiding to a 16th 
emtxxfimert of tfie present invention; 
fHG. 13 is a block diagram of a second digital 
broadcast decoding apparatus(system) according 
to a 17th entxxfiment of the present invention; 
FKx 14 is a block diagram of a second digital 
broadcast deoocfing apparatus(system) accorcfing 
toa 18th emtiodiment of the present invention; 
FKsL 15 is a flowchart of a video signal decoding 
system according to the 15th enfoodiment of tfte 
present irwention; 

Fia 16 is a ffowchart of a video signal decoding 
system accorcfing to the 16th entxxfment of the 
present Inventfon; 

FIG. 1 7 is a t)tock diagram of a (figital broadcasting 
signal storage aocordong to a 19tfi and a twentieth 
erhbodiments of the present invention; 
FIG. 18 is a block diagram of the variable-length 
deoodfog sectfon and variable-length enoodmg sec- 
tion of the 19th embodiment of the present inven- 
tfon; 

FKx 19 is a btock diagram of a variable-length 
decodmg section and a variable-length e rxad i ng 
section aocorcfing to the twentieth embodnnent of 
tfie present invention; 

FIG. 20 is a bfock diagram of a video signal repro- 
ducing apparatus (sy^em) acconfing to a twenty- 
fist entxxtiment of tfie present irrantfon; 
Fia21 is a btock diagram of a digital broadcasting 
signal storage acconing to a twenty-second 
emtxxfimenl of tfie present inventfon; 
Fia 22 is a bfock dfogram of a oorwentional video 
signal layering-enooifing apparatus(system); 
Fia 23 is a bfock (jBayam of a comwitfo na i digflai 
broadcast decocfing apparalus(8ystem); and 
FIG. 24 is a bfock (fiagram of a conventfonal digital 
tjroadcasfina siora) yaywanft 
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DESCRIPTION OF THE PREFERRED BMBODI- 

MEms 

[0066] Embodnrnents of the present irwefilion win 
hereinafter be described in reference 10 the (Ira^^ s 

(First Entexfiment) 

10067] For a video si^iBl iayering-enooiing appem- 
tijs(syslem) aocofding to a first e tiixxftn e nt of the w 
present invenlkm, a description imH be made of the oon- 
stitiiton and operation in rete r ence to FIQ. 1. FKsL 1 
illustrates a tkxk dtegram of the video signal isQfering- 
encocir^g system of tfus entxximert. 
[P06Q] in the figure, 101 is a resoliition convener, 102 is 
a frequency distribution metturing unit, 103 a motion 
detector, 104 nmage memory; 105 a motion oompensa* 
tor, 106 a DOT unit, 107 a quantizer, 108 an encoding 
rate conHroller. 109 an irMrse quantizer, 110 an IDCT 
unit. Ill a mofon compensator, 112 a variabie4er)gth so 
encoder, 113abuffer, 114 a resolution ooiwerter. 115a 
motion detector, 116 image memory, 117 a motion com- 
pensator, 118 a DOT unit, 119 a quantizer, 120 an 
enoodng rate oontroHer, 121 an im^eise quantizer, 122 
an IDCT unit, 123 a motion compensator, 124 a varia- 25 
bi o l en gt h encoder, and 125 a buffer. 
(00691 The main ooristaufonaiflMure of this embodi- 
ment resides in that it is equipped the frequency 
cfistribution measuring unit 102 and that the encocfing 
rate oontroBer 108 sends to the enco(fing rate controller 30 
120 a predetermined control si^ial. 
[QOTQ] In thte embodiment the frequency dfatrfcution 
measuring unit 102 mpkyjfs a higf>pass fBter fiaving a 
pasdtnnd hi^er than a frequency iirated by the resolu- 
tion converter 101. When the quantity of the output (sig- 36 
nal oomponen O of this hi^iipasa fiHer is less than a 
predetermtoed value, Le., in the case where tliequantity 
of the frequency component contained in tfie out- 
put sigral is small, ttie encoduig lale oonlroler 108 is 
constructed so that it increases the rate at which a km 40 
resolution video si^Ql is encoded. Ingerierai, iftfiereis 
a large quantity of motion between frames, an im^ 
itself win k>eGome ambiguous, and therefore, the c^»n- 
tity of tt)e fiigh frequency oorrponent contained in the 
frame wiS be reduced. 46 
IPQ71] In tt)eaiorementior)edoorslitution,tf)e opera- 
tion of ttie video signal layering-enoodmg system of tNs 
entxxfiment wil next be described, and a de w op ti on 
wil be rnade of an eritiodirnent of a video sigmd layer- 
ing-encodvig melfiod aooofding to ttie present inven- so 
tion. 

[0072] An input video signal 100 is converted to a 
lower resolution video signal tfian the input video signal 
100 tyy ttie resolution converter 101. 
[0O7?| TbefrequericydtetribulionrneQSuring unit 102 ss 
measures and outputs fiow much the high frequency 
ooinponenl ttiat is nclt contained in ttie Iw resolution 
video signal converted by ttie resolution oorMerter 1 01 



is contained in the input video signal 100. 

{0074] The motion detector 103 stores the output of 
the resolution converter 101 (Itie encoded frame of the 
input video signal 100) In tfie image memory 104 and 
also detects the motion of a macroblock unit from the 
encoded firame and the previously encoded and 
decoded pest r eference frame in the image memory 
104. 

HOOfTS] The motion oonpensator 105 outputs a dHtor- 
ettfiJ signdl belwocn the video sifflial of the encoded 
frame and tie reproduced video signal of the reference 
frame detected by the motion detector 103 in the unit of 
a nnacroblock. 

[0076] The disaete cosine transform (OCT) mit 106 
outputs the output (dSferenlial signal) of the motion 
compen sa tor 105 as DCT coefficients for each block. 
10077] TTie quantizer 107 quantizes ttie DOT ooefTh 
denis by a quantization step specified by the enoocfng 
ratooontroler 108 and then ou^xits the quantized DCT 

[0079] TYiemverse quantizer 109 inversely quantizes 

the DCT coefficients quantized at the quantizer 107 by 

the quantized quantintion step and then outputs the 

irwetsety quantized DCT coefficient s , 

ffXnSfl The inverse DCT (IDCT) mt 110 outputs the 

output of the inverse quaiitizer 109 as inverse DOT 

ooenoeniSw 

IP06Q] The motion compensator 111 g enerates a 
reproduced video signal tiy addtog tiie output of tfie 
IDCT unit 110 and tiie video signal of tiie r^erence 
ffEtfrie whose motion was compensated at tfie motion 
compensator 105. and then stores the reproduced 
video signal in tfie image memory 104. 
IP081) The varial3le-leng^ encoder 112 varialsle- 
lengto encodes ttie output ol ttie quantizer 107 and a 
preMemnined flag and then outputs ttie variable4engtti 
encoded video signal. 

IP0B21 The buff^ 113 stores ttie variabl»fengtti 
encoded video signal temporarily arxla[$U5ts tfie output 
^peed of ou^ dato ttiereof. That is, ttie buffer 113 oat- 
puts a variafaie^engtti encoded video signal with low 
resolution. 

[0063] The encoding rate controBer 108 determines 
the quantization step of the encoded frame for each 
macroblock, based on the output of the frec^iency cfistri- 
buten measuring unit 102, tfie output (dffierential sig- 
nal) of tfie motion compensator 105. tfie ensoded lengtti 
of the encoded video signal, and the resiAal quantity 
information on ttie buffer 113. 
[0084] That is, wfien tfie quantity of tfie fiii^frequenqf 
component cont ai ned in tfie ou|pul si^iat of tfie flre- 
quency distribufion measuring unit 102 is small, tfie 
enoodmg rate controller 108 increases the encodoig 
rate at which a low resolution video signel is encoded, in 
comparison witti tfie case wfiere the quantity of the 
frequency oorvponent is large. Furttiermore^ tfie encod- 
ing rato controller 108 servis tfie encodtog rate intorma^ 
tion on a low resolution video sigml totfie encoding rato 
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oontroller 120. 

[0065] On the other hanct the resokjimoorwerte 
resolution ooiwerlB the output (reproduced video signal) 
of the motion connpensator 111, le., oon¥ert8thereso- 
lulson off Ihe reprockiced video sigrtal to the same reso- 
lution as the input video signal 100 and then stores i m 
the tmage memory 116. 

IPOBQ Ttie motion detector 115 stores the encoded 
tranie of the inpU video signal 100 in the irnage rnernory 
115 ano aso cmecw me moDon or a macroDiocK ivw 
from the encoded frame, the pronously encoded and 
decoded past reference frame in the bnage memory 
1 1 6, arxt from the reference frame that is the video sig- 
nal of the same time among ttie low resolution signals 
which are the outputs of the resolution converter 1 14. 
I0Q87] That is^ in this motion detection, the motion 
detector 1 15 oonperes the encoded frame of the input 
video signal 100 with the above^nenboned past refer- 
ence frame; tt)e above-mentioned reference frame of 
the same timOi ml a reference frame generated tsy a 
oontwiation of these, and then detects a retorerv» 
frame with the highest oorrelalion in tfie unit of a mac- 
rotslock. The reference frame with the highest correla- 
tion is outpU from the image memory 116 to the mction 

compensator 117. 

[QOflB] As previously descii)ed, generally if there is a 
Ivgequantity of inolion between frames, an image 11^ 
wiB become annbiguous, and therefore^ the quani;^ of 
the high frequency ooniwnen t contained in ttie frame 
wiB be reduced. Therefore, wtienttie quantity of motion 
Is large, tie correlation b^ween the encoded fnme and 
the reference frame of the same time l>eoomes higher, 
and therefore; the reference frame of ttie same Hme is 
output from the image memory 1 16 to tfie motion com- 
pensatorllT. 

I00B9I The motionoompensator 117 outputs a dWer- 
ential signal between the video sigpral of the encoded 
frame mJ tfie reproduced video signal of the reference 
frame detected biy ttie motion detedorl 15 In the unit of 
a macrdAKlc 

[0090] Therefore, in the case of a large quanOy of 
motion as in tfie atxive-mentioned, the quan% of ttie 
cfifferential signal output by the motion compensator 1 1 7 
Is recfcx^d This means that in the case wfiere the quarv 
tify of the high frequency connponent contafried in the 
ir^xit signal 100 is small, the encodfaig rate controller 
120 wll have itHe influence on picture quality even if the 
rate at which a high resolution video signal is encoded 
is reduced. This pofrit will be descrM In frxther detal 
later. 

IP09I] The DOT unit 118 ou^NJtB the ou^xit (diftoren- 
tiai si^riaO of ttie motion coripensaAor 117asIX#^ 
ficients for each block. 

[0092] The quantizer 119 quantizes ttie DOT coeffi- 
cients t)y a quantization step speciied by ttie encodfrig 
rate controller 120 and then outputs ttie quantized DCT 
ooefficientBL 

[0093] An inverse quantizer 121 inversely quantizes 



the DOT oo^icfenls quantized at the quantizer 1 19 by 
ttie quanfized quan&ation step and then outputs the 
Inversely quantb»d DCT ooeliidenl& 

[9094] The IDCT unit 122 outputs the output ol the 
5 inversequantizer 121 as inverse DCT coefficients. 
[q095] The motion compensator 123 generates a 
reproduced video signal by adcfing the output of the 
IDCT int 122 and the reproduced video tignal of the 
reference firanne whose motion was oonpensated at the 

w motion compen sa tor 117, and then stores the repro- 
duced video si)^ in the image memory 1 16. 
IP096] The variable-length encoder 124 variable- 
length encodes the output of the quantizer 119 and a 
predeterrnined flag and then outputs ttie variable-length 

IS encoded video signal. 

10097] The buffer 125 stores the vanabi&4ength 
encoded video signal tennporarily and adjusts the output 
speed of output data thereof. That is, the buffer 125 out- 
puts a variabMength encoded video signal with high 

20 resolution. 

[0098] The encoding rate oonfroNer 120 detemvnes 
the quantization step of the encoded frame for each 
macioblocK based on the encoded state of the low res- 
olution signal estimated at the encoding rate controller 

25 108 O'O., the value of an encoding rate. etc.). the output 
(differential signaO of the motion compensator 117, the 
encoded length of the encoded video signal, and the 
residual quantity infbrmaBo n of the buffer 125. 
[0099] That is, the encoding rate oonfroPer 120 

so receives the erioocfing rate infornntion on a low resolu- 
tion video signal sem from the enoocfing rate controller 
108. And when the encocfing rate information from the 
encoding rate controHer 1 08 indicates that an encocfing 
rate is N^, the encoding rate fr)r a hifllh resolution video 

as signal is reduced so ttiat It does vtii occeed the total 
encocfing rata In this case, as de6crt>ed above, picture 
quality win not be influenced so nruch even if the encod- 
ing rate for a high resolution video signal is reduced. 
IPIOqi Thus, in tills embodfrnenti-e., when the quan- 

40 tity of the high frequency component oonlained in tiie 
input signal 1 00 is small, the encoding rate Ibr a low res- 
olution video signal is increased and tfie encoding rate 
for a high resolution vicfeo signal is reduced. 
[0101] With tills, ttie compression distortion of a low 

45 resolution vicfeo signal can k)ere(ftjced. so a low resolu- 
tion video sigral witti higfier picture quality is obtained 
Furthermore, witii this, the picture qtafity of a high res- 
olution video signal employing a low resolution video 
signal witti enha n ced picture C|ualrty can also be 

so improved at tfie same time. 

(Second EntatimenQ 

[0102] For tfie vicfeo signal layering-enoocfingapparB- 
55 tus(system) accorcfing to a second entxx im ent of tfie 
present invention, a descristion wll t)e nade of tiie con- 
stitution and operation fri reference to FIG. 2. FIQ. 2 
illustrates a block diagram of the video signal layering- 
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enoodng system of this embocfmenL 

[P103] In FIG. 2. tfie same relefence numerals %M^^ 
£^)pi6d to the same parts as FIG. 1 and therefore a 
descnplion thereof is orritled. 
(0104] That is* in Fia 2, 201 is a cfifferential signal 
geneialor, 202 a rnolion detector, and 203 image nrieni- 

ory. 

pnoq As the oper a lion from a resoiulion converter 
101 to a buffer 113 is the same as the contents men- 
tioned in FIG. 1, a description thereof is not given. 
IP106] A resolution converter 114 converts ttie resolu- 
tion of the output (reprtxJuoed video si^iaO gI a rnotlon 
compensator 111 to the sarrte resolution as an irput 
video signal 100 and outputs the converted signal 
[0107] The differential signal generator 201 generates 
a (ffferenlial signal from the inpu video signal 100 and 
the ou^ of the resoiulion converter 1 14. 
pnOO] The motion detector 202 stores the encoded 
franwoffthe oput video sifpel 100 in the irnagemenmy 
203 and also detects the motion of a macroblock unit 
from the encoded frame and the previously encoded 
and decoded past reference franie in the image mem- 
ory 203. 

[pioq Amofioncompensator inoutpi^acfifferen- 
tial signal k>el«veen the output of the differenfial signd 
generator 201 and the reproduced signal at tfie same 
position as the reference frame detected Isy the motion 
detector 202 In ttie unit of a macrobloGk. 
pniOI ThteembodinneritexhiHtethelollOM^advar>- 
tages in addition to ttie advantages mentioned in the 
atxjve-mentioned first embod im en t 
[0111] That is, tjy having the frequency dtetnbution 
measuring unit 102 and the (fifferential sigrial generator 
201 , encocfing quantity control aocorvfing to a frequency 
coinporiert corilained in ttie input video sigrial 100 can 
be performed belvveen layers in the Nerarchical coding 
in which an encoded sigral at a high resoiulion oornpo* 
nent is a diff e re nti a l signal wHh a video signal repro- 
duced from a tow resoiulion component 
[0112] Note that me motion detector 202 in this 
eiTtxxfiment may use the output (video signaO of the 
resolution converter 114when motion is detected. 

(Third Embodiment 

10113] in FIG. 3. ttie same reference numerals w9 be 
applied to the same parts as FIG. 1 and therefore a 
d ehU |)tiontttereofisomitled. 
pni41 That Is, in Fia 3. 301 is a motion judgment unit 
and 302 an enoodiig rate oorMter. 
IfhtSl As sfiown n the figure; ttie rnotion judgrnent 
unit 301 judges the motion of an input video signal 100 
from the motion detection resutt of a mofon detector 
103 and outputs the result of the ludgmert. 
[D116] The erxxxfing rate controier 302 determines 
the quantization step of tlie encoded frame of the input 
video signal 100 for each macrobtocK based on the out- 
put of tfie molion Judgment unit 30 1 , the ou^ ((fiffer- 



ential signal) of a motion compensator 105, the 
encoded length of ttie encoded video signal, and the 
residual quantity of a buff^ 1 13. 

[P117] In this entxxfirneni, by having the motion judg- 
B ment unit 301, enoodng (^jantity control aocorJng to 
the molion of the input video signal 100 can be per- 
formed between layers. 

IP118] ftote that the motion judgment mit 301 in this 
embocfiment m^y judge motion not by employfrig the 
10 result of the molion detected at the motion detector 103 
but by errploying the result of the molion detected at the 
motion detector 1 15 which detects motion only from the 
encoded frame of ttte original video signal and a refer- 
ence frame. 

15 

(Fourth Embocfiment) 

[Oliq to FIG. 4, the same reference numerals will be 
applied to the same parts as FIGS. 1 and 2 and there- 
20 lore a description thereof is onrttted. In the figure. 401 is 
a motion jud^nent unit and 402 an encoding rate con- 
troller. 

|pi2iq The motion judgment unit 401 judges the 
motion of an input video signal 100 from the motion 
25 detection result of a motion detector 202 and outpute 
the result of the judgment. 

10121) Thus, the molion judgment urnt 401 can 
enhance molion judgment aooracy; unfike the above- 
mentioned embodiment where motion is judged based 
90 on the co n verted low resoiulion video signal. 

[0122] The encoding rate controller 402 detennines 
the quantiration step of the erxxxted frame of the input 
video signal 100 for each macrcblock, based on the out- 
put of the motion judgment unit 401. ttie output (differ- 
as ential signal) of a motion compensator 105, the 
encoded length of the encoded video signal, and the 
residual quantty of a buffer 113. 
VnZSl In thisi embodfrnent. by having the differential 
signal generator 201 and the motion judgment wit 401. 
40 encocfing quantity control accorcfing to the motion of the 
input video signal 100 can be performed between layers 
ki the Nerarchical cocfing in which an encoded signal at 
a Ngh resolution conrponent is a cfiffererrtial signal with 
a video signal reproctoced from a low resolution conpo- 
45 nent 

10124] Note that the motion judcpnent unit 401 in this 
embodimen t may judge molion tiy enployfrig the result 
of molion detected at the motion detector 103. 

so (FIflh EiiixxfimenQ 

[P12S] In FKx 5, the same r^enca numerals wni be 
applied to the same parts as FIGS. 1 and 3 and there- 
lore a description thereof is onwtted. In the figure^ 501 is 
66 an encodmg rate controller. 

[0126] As shown in FIG. 5. the encoding rate control- 
ler 501 determines the Quantizalion step of the encoded 



frame of an frvxA video signal 100 ft)r each macrobtocK, 
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bosod on the omput off alreQuemy cfelribiition nwosur- 
Ing um 102, llw output off a molton judgnwm iv^ 
the oi4put (cfifferentiai sIgnaO of a mofon oornpensalor 
105. the encxxled length of an encoded video si^ial, 
andtheresidualqiiantityof atxiffer 113. 5 

[0127] In this enrtKxfiment. t]y having the frequency 
dtetnbulion measuring uwt 102, enoodHng quanti^ con- 
tioi aoooRfing to a fireciuencsf component oontaned n 
the input video signal 100 can be pertormed ti ot w roon 
layers, and bf having the motion judgment unit 301, 10 
encocing quartfty control according to ttie motion of ttie 
input video signal 100 can be performed t^etiveen lay- 
ers. 

[0128] Note that the motion judgment unit 301 in this 
entxxfiment may 'futige motion not by erqploying the is 
result of the motion detected at the motion detector 103 
Dut Dy eiifmjytng me resun 01 me motion oeieciea ai me 
motion detector 115 wtMi detects motion only from the 
encoded frame of the original video signal and a refer- 
enceflrama 20 

(Sixth Emtxxliment) 

[0129] In FIQ. 6, the same reference nwneralswilt>e 
applied to ttie same parts as FIGS. 1. 2, and 4 and ss 
therefore a description thereof is omitted. In ttie figure^ 
601 is an enoodbig rate controller. 
[OlSCn As shown in FIQ. 6, the encoding rato control- 
ler 601 detemines ttie quantiEalion step of the encoded 

frame of an input video signal 100 for each macrotslocK so 
based on the output o4 a frequency (Kstrtxition measur- 
ing unit 102. the ou^ of a motion ^jdgment una 401, 
the output (differential signaf) off a motion compens a tor 
105. the encoded leng^ of an encoded video signal, 
andthereslc^cpjar^ofatxjffer 113. as 
I0131I Noto that the motion judgment unit 401 in this 
entxxliment may judge motion tiy enyl o y i ng the result 
off moSon detected at the motion detector 103. 
[{0132] in ttie a for e men ti oned e i itmin i ei itB, aMioufl>i 
tlie frequency dNstiixJtion measuring means of ttie ^ 
present invention en^ioys a liighisass f9ter tiaving a 
pas6t)and ftigher than a frequency fmited tiy ttie resolu- 
tion converter 101. the present invention is not imited to 
this. For example, the frequency distrtwtion measuring 
means rr«y be constructed as foliowvs. 4s 
[P133] That is» wtien the resolution converter 101 is 
liinited t)y a lowi)ass filter arid atso ttie frequericy cffiar- 
aderistic is represented by F, a tiig^i-pess ffter repre- 
sentedtiy 1 -F may t>e employed. In ttis case; wlien ttie 
output signal component of ttie Ngti^asB fitter is less 50 
than a predetei niiiied valuer ttie rate at wtiich a signal is 
encoded t)y ttie encoding rate oortroller 108, 501 or 601 
isinaeased. 

[P134] As another constitution, the frequency dtetriiu- 
tion measuring unit 102 may convert an input video sig- ss 
nal to a tow resolution video sigrvd i n ttie same manner 
as the resolution converter 101 and add ttie Absolute 
value sum off a differential signal belwfeen a reproctoed 
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video signaf with the same resolution as the input video 
signal and the input video si^ial in the same manner as 
the r esolution converter 114. In this case, wtien $}e 
tibsobite ^hie sum is smaB. the rate at wtiich a signal is 
encoded by ttie encocing rata controller 108.501 or 601 
is increased. 

|Q13q As stil another constitution, ttie frequency dis- 
trfbulion measuring unit 102 may convert an input video 
signal to a kMr resohition video signal in the same man- 
ner as the resohilioncorwerter 101 and add the atjso- 
lute value sum off a differential signal t>et«Neen a 
reproduced video signal with the same resolution as ttie 
input video signal arvl ttie irput video signal in the same 
manner as itie resolution corwerter 114 only when the 
absolute value sun is greater than a predetermined 
valua In this case, wtien ttie etsoMe value sum is 
smal, the rate at which a signal is encoded by the 
encodkig rate controller 108, 501 or 601 is increased. 
pnaS] AlsoL the motion judgment unit 301 and notion 
^jdgment unit 401 in the aforementioned embodiment 
may increase ttie rate at which a signal is encoded by 
the encoding rate controller 108, 501 or 601, when 
motion is great 

10137] In ttie above-nfieritioried errtxxinients, wtvle it 
ties been descritied ttiat ttie sum of ttie encoded bit 
slreanrs ou|Mt from the txiffers 113 and 125 is always 
constant per unit time, the present invention is not lim- 
iled to thiSw Even if the sum off ttie bit streams varies with 
time, ttie ctove-menboned emtxxfimentB wffl be appB- 
cabla 

(Seventh Embodiment) 

[0138] For the video signal layering-encoding appara- 
tus(sy6tem) according to a seventh emtxxfiment of ttie 
pr^ent invention, a description wBI t>e made off the con- 
stitubon and operation in reference to FIG. 7. FIG. 7 
austrates a block diagrmi of the video signal layering- 
encoumg system or ins errooanienL 
(0139] In the figure, 701 is an inpidtenrinal to which 
a video signal is input 702 a resolution reduction unit for 
reducing ttie resolution of the input video signal to a pre- 
determined resolution. 703 a first encoder for enoocing 
ttie input video signal at a kwv t>it rate, 704 a second 
decoder for decoding ttie input video signal at a low t)it 
rafte, 706 an interpolator for iriterpolatirig ttie rwmber of 
the pixels of ttie input signal so ttiat it t)ecomes a fvede- 
tennined number of pixels* and 706 a second encoder 
for ervxxfing ttie input video sigrai at a low t)it rate. 
|!0f4Cq The operation of ttie aforementioned constitu- 
tion wH tiereinaffter t)e descrtoed. 
[0141] A Ngh resolution signal input ttvough ttie input 
tenminal 701 is output to the second encoder 706 and 
ttie resolution reduction unit 702. The resolution reduc- 
tion unit 702 reduces ttie resolution of ttie input signal to 
a predetermined resolution and outputs ttie resolution 
reduced si^ial to the fist encoder 703. Ttie first 
encoder 703 encodes the ir^ signal at a low txt rate 
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and oulpiai the encoded dsia to ttie secnnd decoct 
704. Tlie Mcbnd decoder 7M deocxSeB Itie Snpul eignal 
at a lOMT bit mto and oulsulB the decoded signal to tto 
inlerpolatar 706. Hie iirt eipolator 705 interpolates the 
input video signal so that the nunnber of the pixels s 
thereof becomes the same numt)er of pixels as the 
resotulion signal, and then outputs the interpolated sig- 
nal to the second encoder 706. 
[P14SQ In the second encoder 706. the hig^ resolution 
signal is encoded at a lOMr bit rate and output by eSher io 
spatial resolirtion predictive oodkig ervf^^ 
dicdon in a spatial axis (firection (e.g., encodffig or a dif- 
ference betwreen an interpolated signal and a high 
resolulion signaQ. intraframe coding which employs 
data within the frame of a high resolufion signal, inter- is 
franrie forward precfidive codng which ernploys tonM«^ 
prediction in the time axis direction of a high resolufion 
signal, or interframe bdtoclional predictive coding 
whkii env^loys bidirectional predtetion in the time axis 
direction of a high resolution signal. ^ 
pn4?] Here, when the second encoder 706 perfonnw 
Interframe bidirectional predictive coding, preiiGtod dif- 
ferential data is not encoded, but oriy the mo6on vector 
detected by erTV)loyiiig interframe bicSredional pred»- 
tion is encoded. ^ 
[D144] Generally, since a bidbectionatty predkited 
franrie is often the average of tm frarnesw it beoornes an 
object of encoding, but even If a motion vector alone 
were encoded, a ^eot influenoe wil not occur on pic- 
ture c^jafity. In the case where a high resolution sigrial is 30 
decoded, it is also po6Si}le to employ the interpolaled 
image of ttie decoded image of a kMf resolution sign^. 
Therefore, even if a rriotion vector alorie were encoded, 
picture quaEty wfll not be degraded. 
[014q As descnbed above, the video signal enoocfing as 
system of ttie present invention is capable of increasing 

the encoding efficiency of a high resoMion signal, 
because the encodung quantity of a bidirectionally pre- 
dkMI and coded high resolution signal can be reduced 
by encoding only a motion vector employing iiAerfiame 40 
tjidlrectional prediction. 

(Eigtith Embodiment) 

[0146] In FIG. a 801 is an input terminal to which a 45 
video signal is input. 80e a resokilion reduction unit for 
redudng the resolufion of the input video signal to a pre- 
deteriiined resolution, 803 a first encoder for encodtog 
the input video signal at a low bit laie^ 804 a second 
decoder for decodbig the input video signal at a low bit so 
rate. 805 an Interpolator for interpolating the nunnber of 
the pixels of the input signal so that it becomes a preda- 
terinined nurit)er of pixels, and 806 a second encoder 
for encodbig the tnpU video signal with a predetermined 
control determiriedtjy input intorrnatioa ss 
IP147] The operation of the aforementioned constitu- 
tion win hereinafter be descrt>ed. 
101461 A Ngh resolution signal input through the input 
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temmal 801 Is output to the second encoder 806 and 
the resolution reduction unit 802. The resolution reduc- 
tion unft 802 reduces the resolution of tlie irput signal to 
a predete r mi n ed resolution and outputs the resolution 
reduced signal to the first encoder 803. 
(0143] The first encoder 803 encodes a low resolution 
si^ial at a low bit rate by ertfier (1) intraframe cocfing 
which employs data within tfie frame of a low resolution 
signal. (2) interframe fonMud precfictivB cocfing which 
ernploys fonmrd prediction in the tirne aods cErection of a 
low resolution signal, or (?) interframe bidirectional pre- 
dtotive coding which enploys bitfirectional precfictfon in 
the time axis (firection of a low resolution signal. The 
first encoder 803 outputs the encoded data to the sec- 
ond decoder 804 and also outputs to the secorvi 
encoder 806 which of the intraframe coding, the inter- 
fianrie fOHMard predtetive oocfing, arvl tfie interframe 
rectional predicfive coding was employed to erxxxie the 
encoded data The second decoder 804 decodes tiie 
input signal at a low bit rate and outputs the decoded 
signal to ttie interpolator 805. The interpolalor 805 inter- 
polates the input video signal so that the number of the 
pixels tfiereof becomes the same number of pixels as 
the input video si^ial, and then outputs ttie interpolated 

signal to the seconJ encoder 806. 
{0150] In the second encoder 806. the tugh resolution 
signal is encoded at a low bit rate and output by (1) spa- 
tial resolution predictive coding which emptcys precfic- 
tion in a spatial axis direction (ag.. encocfing of a 
differ e nce between an interpolaled signal and a 
resolution si^uO and (2) cocfing of the same type as tiie 
oocfing type employed when each frame converted to a 
low resolution signal is encoded at ttie first encoder 803. 
As previously described, the Information on which 
encocSng type was enrployed in the frst encoder 803 is 
sent from tive first encoder 803 to tiie second encoder 

806. 

IP151] Also^ when tiie second encoder 806 in tivs 
embodment as witii tiie seventh embodiment, per- 
forms interframe bidirectional predictive coding, pre- 
dated dHlerential data is not encoded, but only tiie 
motion vector detected by employing interframe bidirec- 
tional prediction is encoded. 

[0152] Thus, in tt>e video signal erxxxfing system In 
this embodiment, in addition to tfie same advantage as 
ttie seventh emboctiment, frame encoding types 
become the same when a low resolution signal and a 
fvgh re s olu ti on signal are encoded, so it k)eoomes pos- 
si)le to use the motion vector of a low resolution signal 
in encoding a fiigh resolution signal, and corsequently. 
errar tolerance is increased. 
ID153I As a variation of tiie above-mentioned errixxl- 
iment, the present irwention may k>e cor«tituted so tint 
when tf>e first encoder 803 perfomre i i m af r am e cocfeig. 
the atxyve-mentioned second encoder 806 performs the 
intraframe cocfing on a frame corresporvfing to the 
frame. WHh tins constitution, tiie de^ee of importance 
relative to an error in the atxwe-mentioned fifame is 
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increased, and therefore, by st re ngthening enor loler- 
ance In that frame, enor toieranca in the entire stream 
can be easity strengtftened. 

(Ninth EnixxfmenO 

pn541 A nir^entxxfcnent of the present invention is 
the same as FIQ. 8 and dWeis only in the operation of 
ttie second encoder 806. 

IptSSl The operation of the second enooder 806 in 
this entxximent hereinafter be described. 
[01561 in the second encoder 806 in th» embodiment, 
for a frame oorresponcfing to a frame encoded at the first 
encoder 803 fay eAher intraframe coding or interframe 
forward (firectional precfictive codng, a motion vector 
employing interframe bidirectional prediction is 
encoded, and a fraine corresponding to a frame \M4iich 
is encoded by interframe bidiredionai predn6ve oodng 
is encoded by either ntialrame oocfirig or inlBifr^ 

ward directional predictive coding. 
[0157] In the oodffig method employing the time axis 
(Section of a video signal, m order to enhance pictire 
quafity. an encoding quantity is allocated to intraframe 
oocfing or interframe bidirectional oocfing and is not dto- 
cated to interframe bidirectional coding which is the 
average of two frames. Therefore, generally picture 
quafity is better in intraframe coding or interframe for- 
ward directional codnng tiian in interframe b i d» ectio nal 
cocfing. 

[0158] l^ence, by setting the above-mentioned encod- 
ing mode, a r^ence frame, which is encoded by spa- 
tial inter-resolution precfictive cocing when a high 
resolution signal is encoded fay interframe l)idkectional 
predictive ooc&ig, is encoded by either tiie intraframe 
coc^ or interframe fonward directional predkitive cod- 
ing of a low resolution signal. Therefore^ since the refer- 
ence frame in this embodiment has higher picture 
quality as compared with tiie eighth enrtxxfiment, spa- 
tial inter-reeoiution predtative coding can be more elteo- 

tively utiliud. As a result, encodmg ol a motion vector 
becomes unnecessary and ttie encocfing effidency can 

t)e enfianced. 

10159] fMe that the encxxfing of a motion vector 
t)ecomes unnecessary only wfien ttie first encoder 803 
performs interframe tonivard directional predk:tive cod- 
ing. As descnbed atxive. in ttie video signal encodng 
system in tttis entafiment, in adctition to the same 
advantage as the seventti entodiment. the pidure 
quality of a r e ference frame obtained liy spatial inter- 
resolution predction is enhanced when inlerframe bidi- 
rectional predk;tive oodmg is performed, wtiereby the 
encodng efficiency of a hig^ resolution signal can te 
irnproMod. 

(Tentti Embodiment 

[P1601 Aterittierii)odaiientof1tiepre8eritirweiitionis 
ttie same as fHQ. 8 and differs only in ttie operation of 
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ttie second encoder 806. 

E0t61] The operation of ttie aeoond encoder 806 in 
ttiis embodbnent wil hereinafter be described. 
[0162] bi ttie second encoder 806 in ttiis embodiment, 
for a ftwne corresporidHrig to a frame erxxxied at tfie first 
encoder 803 by eittier interframe fonMard directional 
oodng or interframe bidr e ctional predctive coding, 
encoding of the same type is performed, and a frame 
correspondmg to a frame encoded at ttie first encoder 
803 by intraframe coding is encoded at a low bit rate by 
envjioying only «patiai inter-resolution predictive cod- 
ing. 

[p163] Thus, since a hig^ resolution signal is not 
encoded tjy inli af rame oodaig, an encocfing quantity 
can be reduced and therefore the encodng elfidency of 
a high resolution signal can k>e improved. 
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(Beventti Emkxxfiment) 

{^64} An eleventti embodiment of the present inven- 
tion is ttie same as FIG. 7 and differs only in ttie opera- 
tion of the second encoder 706. 
10165) The operation of ttie second encoder 706 in 
this embedment wiB hereinafter be desotoed. 
(01661 In ttie second encoder 706 in ttusennbodment, 
encodng is performed at intenrals of M frames (where 
1) by employing only spatial inter-resokition predc- 
tive codng. The ottier frames are encoded by eittier 
intertrame forward drectional predictive coding or inter- 
frame bidirectional predctive codng. 
10167] Thus, as witti ttie tenth embedment a high 
resolution signal is not encoded by intraframe oodhg. 
80 that the encoding quantity can tie reduced and the 
encodng efficiency of a high resolution signal can be 
increased. Furthermore, as a difference iMtti an interpo- 
lated image is encoded at irttervals of M frames, emy 
propagation in a time axis drection can be stopped at 
intervals of U frames. Ther^e^ as M becomes 
snaler, ttiis embodmnt has better error toieranca If M 
is less ttian the GOP unit VI ttie tentti embodmenl ttiis 
errtxxf ment wH have t>etter error toferance than ttie 
tenth emtxxSmenL 

nWelfth EmbodmenQ 

[0168] A twetfttiembodment of the present invention 
is the same as FIG. 8 and differs only in ttie operation of 
the first and second encodere 803 and 806. 
10169] The operation of ttie first and seoorvl encoders 
803 and 806 in ths embedment wHI hermafter be 



[01701 The first encoder 803 in this entxxfment 
encodes an input signal at a kNv bit rate and outputs ttie 
encoded data to a second decoder 804. Ttie first 
encoder 803 also outputs both ttie motion vector used in 
ttie encoding and ttie encodng type to ttie second 
encoder 806. In ttie secorxJ encoder 806, for the frame 
of the encodng type encoded at ttie first encoder 803 liy 
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either inlerframe fbrira^ 

iiilei frame tsidNection&l pracidive oocfng, fie input 
motion vector muHipBed by a pred e <y 
used as a motk)n vector in order to CDcdixte the data of 
the rnolk)n vector, and then ertcodng is performed 

[0171] Therefore, in the video signal ericoding system 
in this eRtxxfmem, the overatt ctfcuft size can t>e 
reduced t>ecause the motion vedor of ttie frame of a 
high resolution signal is not detected, and the enoodmg 
efficiency of a high resolution signal can t)e imased 
t)eca u Be a motion vector is not encoded. 

(Thirteenlh Entxxliment) 



[0172] For the video Signal layering-en 
tus(6ystem) according to a thirteenth embocirnent of the 
present inimlion, a desa^ilion win k>e rnade of the oorv 

stitulion and operation in reference to FKx 9. Fia 9 
illijstrales a bloGk cSagram of the video signal layering- 
enooding apparatu8(^stem) of this ennbodirnenL 
[017^ Iri the figure. 901 is an IrputterinM to which 
a video signal is input, 902 a resolution redaction unit for 
reducing the resolulion of the vfNJt video signal to a pre- 
determined resolution. 903 a first ericoder for encocing 
the input video signal m a lew bit rate tjy errploying in^ 
irtformation, 904 a second decoder fx decodmg the 
input video signal at a low bft rale. 905 aninterpolator 

for interpolating the number of the pixels of the input sig- 
nal so that it becomes a predetermined number of pix- 
els, 906 a second encoder for encoding the input video 
sign^ by employing irput information, and 907 a motion 
vector detector for detecting the motion vector between 

input signals. 

[0174] The operation of the aforementioned constilu- 
tion ¥vitt hererafter be descri>ed. 
|017q A high resolution signal kiput through the ir^xJt 
terminal 901 is output to the motion vector detector 907, 
the second encoder 906, and the resolution reduction 
unit 902. The motion vector detector 907 detects the 
motion vector of ttie input signal and outputs the 
detected motion vector to tiie second encoder 906 and 
the first encoder 903. The resolution reduction unit 902 
reduces the resolution of the input signal to a predeter- 
mined resolution and outputs the resolution reduced 
si^ial to the first encoder 903. The first encoder 903 
uses ttie input motion vector muftipKed bf a predeter- 
rnined nurit)er as a rnotion vector so that a kMT resolu- 
tion signtf is encoded at a low bit rata The first encoder 
903 oulputs the encoded data to the second decoder 
904. The second decoder 904 decodes the input sigmd 
at a low bit rate and outputs the decoded signal to the 
interpolator 905. The in terpolator 905 interpolates the 
input video signal so that the number of the pixels 
thereof becomes the same niMnk>er of pixels as the input 
video signal, and then ou^xjls the interpolated signal to 
the second encoder 906. 

[P176] The second encoder 906 encodes and oulputs 
a high resolution signal at a low bit rate by using both 



spatial resolution predictive coding which employs pre- 
dtalion In a spatial axis drection (eig., encocing of a (fif- 
lerence between an inlerpolaled signal and a high 
resolution slgnaQ and tiie input motion vector. In this 
e case; the motion vector is also encoded. 

[D177] Note ttiat, due to the same reason as tiie 
alx3¥e-mentioned emixxtiment ttie first encoder 903 
encodes and oulputs a lew resoiution signal at a low bit 
rat^ excluding a motion vector. 
w pi78] Therefore; in the video signal encoding system 

in this embodiment, the overall circuit size can be 
reduced because the motion vector of tiie frame of a low 

resolution signal is not delected, and ttie encoding effi- 
cient of a Ns^ resolution signal can be inaeased 
15 because a motion vector is not encoded. 

[P179] Also; tiiisernbocfirnentertf ia nces motion vector 
accuracy, because it is constituted so ttiat a motion vec- 
tor between input signals wfth high resolution is 
detected. 

20 

(Rxjneentii Emboctiment) 

jpiWl toFiaiO,1001isanlnputterminaltDwhicha 
video signd is Input, 100e a resolution reduction unit for 

ss recjkicing the resolution of tiie inpiA video si^ to a pre- 
determined resolution, 1003 afirst encoder for encoding 
ttie input video signal at a low bit rate. 1004 a second 
decoder for decocfng ttie input video signal at a kMT bit 
rate; 1005 an intefpolator for Interpolating ttie number of 

30 ttie pixels of ttie input Signal SO ttiat it becomes a prede- 
temnined nuntier of pixels, 1006 a dHlerential unit for 
computing a ctiller e nce b^ween input signals, 1007 a 
band dwider tor dwiding ttie band of ttie ir^xjl signal, 
and 1006 a second encoder for encoding ttie input 

96 videosi^iai. 

[0181] The operation of ttie aforementioned constitu- 
tion wiB hereinafter t>e descri)ed. 
{Oiaq A high resolution st^ial input ttvou^ ttie input 
terminal 1001 Is output to ttie resolution reduction unit 

40 1002 anddHferential unit 1006. The resolution reduction 
unit 1002 reduces ttie resototion of ttie irput signal to a 
predetermined resolution and outputs the resolution 
reduced signal to ttie finsl encoder 1003. The first 
encoder 1003 encodes ttie input signal at a lew bit rate 

45 and outputs the encoded data to ttie second decoder 
1004. The second decoder 1004 decodes the input sig- 
nal at a low fait rate and oulputs ttie decoded signal to 
ttie interpolator 1005. The interpolator 1005 interpo- 
lates ttie input video signal so that the nunrA>er of ttie 

so pixels ttiereof becomes the same nunter of pixels as 
ttie input video signal, and ttien outputs ttie interpolated 
signal to ttie dHferenti^ unit 1006. The diferential unit 
1006 oomputes di ffe re n tia l data between ttie same 
frames of ttie input signals and outputs ttie dmerential 

55 data to ttie band cfivider 1007. The band dwider 1007 
(fivides ttie input signal Into a plurafity of video signals 
tiaving a predetermined bsmd arxj outputs them to the 
second encoder 1008. The second erxxxler 1008 
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encodes and cxj^puls Ihe input sigrKdB at a low M 
I0189I As descrit)edalx)ve. the video signal enoodbig 
system in this entxximent enploys dHierent kinds of 
encoding methods in a tovv resolution signal and a higti 
resolution signal. Therefore^ iff both signals are com- s 
bined togelher, a high resolution signal can t>e encoded 
so that it is effective. As a result, it becomes possiie to 
enhance the picture quality of a high resolution sifi^. 



(Fateenth Bnnbocfiment) 

[0184] m Fia 11, 1101 is a demodulating section. 
1102 a separating section, 1 103 an «jdk> signal decod- 
ing section, 1104 a video sigraldeoodrng section, 1105 
a variat)le-length decoder, 1106 an irmrse quar^izer, 
1107 an IDCT unit. 1108 a motion oompersalor, 1109 
memory. 11 10 a memory comroler, 1111 avideosignBi 
decoding section. Iliaavariable-lengttideooder. 1113 
an iiwerse quantizer, 1114 an inverse dHferentiai pulse 
code modulation (DPGM) unit. 11 15 a nriotion oompen- 
sailor, 1116 memory; 1117 a memory oontroler. and 
1 1 1 8 an overlay section. 

(0185] Ttie operation in ttie aforementioned constitu- 
tion will hereinafter be de8crt>ed. 
[0186] The demodulating section 1101 performs a 
predetermined demodulation on a received digftal 
broadcast, thereby generating an MPEG stream. 
(0187] The separa ti ng section 1102 separales the 
video and audio signal confiressed streams on a pre- 
detenimed channel from the generated MPEG streara 
(0189) The audk) signal decodhig section 1103 
decodes the audk> signal compressed stream and out- 
puts an aucfio signd. 

(01891 In the video signal decoding section 1104.(1) 
the variable4englh decoder 1105 variable^engtii 
decodes the aforementioned video signal compressed 
stream and outputs the motion vector off a ma crotalock 
unit, a quantization stepi and IXJT coefficient s . (2) the 
inverse quantizer 1106 inversely quantizes tfie OCT 
coefficients liy the quantization step decoded in the unit 
off a m acroblock. (3) the IDCT unit 1107 outputs the 
inversely quantized OCT coefficients as IDCT coeffi- 
cients (4) the motion compensator 1108 reproduces a 
video si^rial from the IDCT coefficients obtained by 
employing a motion vector and also from the si^ial 
stored in the memory 1109 in a ma ao bl o c K uriit, and g) 
ttie mernory controller 1 1 10 controls the storage of ttie 
reproduced video signal to tt>e memory 1 109. Iffie ou^ 
of ttie video signal stored in ttie memory 1109 to ttie 
motion oonpersator 1108. and the output off the repn>- 
duced iMeo si9^> ttiereby oulpu t ling a d oc od od video 
signal A. 

(01901 On the otier hand, in itie video signal deoodkig 
section 1 1 1 1 . (1) the variable-lenglh decoder 1 1 12 vari- 
able-length decodes the vxteo signal oonpressed 
stream and outputs ttie motion vector off a inac r ot^lock 
unit, a quantization step^ and DC coefficients, ttie 
inverse quantizer 1113 irmisely quantizes by the 
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decoded quantization step only the DC ooefficient& 
quviHzed at thetime off encoding. the inverse DPCM 
unit 11 14 performs inverse Di=*CM on only the DC coef- 
ficients on which DPCIM was performed at the time off 
encodmg. (4) the rnction conpensator 1 1 15 repioGhioes 
a video sic^ from a signal reproduced by employing a 
motion vector multiplied by 1/3 and also from a signal 
stored in ttie memory 1 1 16 in a macroblock unit, and (5) 
tlie memory oontroOer 1 1 17 oor^mls the storage of ttie 
reproduced video signal to the memory 1 1 16, the output 
off the video signal stored in the memory 11 16 to the 
motion compensator 11 15. and the output of the repro- 
duced video signal, thereby outpulting a decoded video 

Signal n 

{0191] tnlheovertay section 1118, the video signal B 
(which is 1/d off ttie video signal A in botti horizontal and 
vertical drections) reproduced at the video 
decodng section 1111 is overlaid at a pred^ermined 
portion on ttie video signal A reproduced at ttie video 
sigrfil decoding section 1 104. and the overiaid signal is 



10192] Thevideosignaldeoodingsectionllllinttiis 
eiTtxxfiment is realizable by a si^ process very easy 
as compared witti ttie video signal decodng section 
1104 and wfth a less memory quantity (spedficaRy, 
memory capacity of 1/54 of ttie memory 1109), so it is 
also realizable fay software. Alsa a predetermined vec- 
tor tra r ctorm ati on may be errpk^ to obtain ttie 
motion vector multiplied tiy 1/8. 
(0193] WHh ttis, ttie cental broadcast decoding sys- 
tem in ttiis enrtadirnent can readily display a broadcast- 
ing program on a different channel onto a small screen 
wfttiin a main screen during reception of dgital broad- 
casts, by havvig ttie structuraity ssnple video signal 
decodtfig section 1111 in a conventional (tigital broad- 
cast decocting system. 

[0194] H&A, ttie operation of ttie abovo^nentioned 
video signal decodvig section 1111 win be descrt)ed 
furttier in reference to FIGL 15. 
(0196] Fiai5sho«vsaflOMhartusedtoa(plairiidgo- 

rittmi. 

[0196] Inttiefigure, instep l.variabMengtti decod- 
ing is performed on ttie video si^ial stream compressed 
by ttie MPEQ standard, whereby only ttie motion vector, 
quantization step, and DC coefficients are extracted. 
[0197] In step 2, only when ttie DC coefficienls have 
t>een c^jantized. they are inversely c^antized by ttie 
quantization step decoded. 

[0198] In step 3, only when DPCM has been per- 
fbrmed on ttie DC coefficienlBi inverse DPCM is per- 
formed on ttie decoded DC ooelfiuontEk. 
19199] In step 4 ttie decoded motion vector is mifi- 
plied by 1/8 in botti ttie hortenlal and vertical dmtions. 
and motion conpensation is performed bf erTf)loying 
video signals corresponding to ttie DC oorrponent 
being reproduced and ttie previously reproduced DC 
component 

10200] fen step 5 ttie video signals corresponding to ttie 



20 



39 



EP0901289A2 



40 



inolion oonpensated DC uxi|XWiBnl & are stored tem- 
porarily; and ttie video signals are ouipiit in display 
order. 

[0201] By eiTfiloying the aforementioned algorithm, 

the video signal stream conrpressed t3y the MPEG 

standard can be reacfly reproduced ki a size of 1/8 in 

both the horizontal and vertical (firectBons. 

[0202] Note that since the aforementioned algorithm 

is an easy prooesSb it is reafizatsie by software and can 

also be processed in paiaM. 

[0203] Also^ a predetermined vector Hansformalion 

rnay be enptoyed to obtain the motion vector rnitv^ 

by 1/8. 

(Sixteenth EnnbodimenI) 

HCM] In FKsL 12 the same reference nunoeralswffl be 
appSed to the same parts as Fia 11 and therefore a 
description thereof is omitted. 
fjODSl In Fia 12 J201isavideosignaldecoding sec- 
tion, 1202 a variabl&4englh decoder, 1203 an inyerse 
quantizer. 1204 an inverse differential pulse code mod- 
ulation (DPCM) unit 12(^a motion compensator, 1206 
memory, and 1207 a memory controller. 
Pk206] The operation in the aforementioned constitu- 
tion VMll fiereinafter be descrt>ed. 
{P207] The demodulating section 1101 performs a 
predetermined demodulation on a received digital 
broadcast, thereby geneialing an MPEG sbeam. 
pnoq Itie separating section 1102 separates ttie 
video and audfo signal compressed streams on a pre- 
deterrrined channel from ttte generated MPEQ streera 
[p209] The audio signal decoding section 1103 
decodes the audio signal compressed stream and out- 
puts an audio signal. 

[021O] The video signal decoding section 1104 out- 
puts a decoded video signal A. 
PI211] In ttie vbeo signal decoding section 1201, (1) 
ttie varlrtato longttt decoder 1202 variabl&tengtti 
decodes ttie video signal compr e ssed stream and out- 
puts the motion vector of a macrobfodc uiit aquantiza- 
tion stepy and IM X N DCTcoelficiento (M coefficients In 
a horizontal direction where M is a iiaAural nurit>er from 
1 to 8 and N confidents in a vertical direction wliere N 
is a natural nunt}er from 1 to 8). (2) ttie inverse quan- 
tizer 1203 inversely quantizes by ttie decoded quvitiza- 
tion step only tfie M x N DOT coefficients quantized at 
ttie time of encoding, (3) ttie inverse DPCM urvt 1204 
peridrms inverse DPCM on ttie M x N DCT coeffioents 
on which DPCM was perfomned at the time of encoding 
and then outputs an M x N signal, (4) the motion com- 
pensator 1205 reproduces a video signal from a signal 
reproduced by employing a motion vector mult|piied by 
M/8 in ttie horizontal direction and by NO In the vertical 
(firection and also from a signal stored in the memory 
1206 in a macrobiocl( unH, and (9 tfie memory control- 
ler 1207 controls ttie storage of tfie reproduced video 
signal to the memory 1206. ttie output of ttie video sig- 



nal stored in ttie memory 1206 to ttie motion oonpensa- 
torl205, and ttie output of ttie reproduced video signal, 
ttiereby outputting a decoded video signal B. 
I0212I In ttie overiay section 1118, ttie video signal B 

5 (which is M/8 of ttie video signal A in ttie horizontal 
(firection and N/8 of ttie video signal A in ttie vertical 
(firection) reproduced at ttie video signal decoder 1 201 
is overlEttd at a pre()etermir!ed p()6rtion on ttie video sig- 
nal A reproduced at ttie video signal decoding section 

w 1201, and ttie overiaid signal is output 

IQ213] The video signal decoding section 1201 in tills 
errtxxfiment is reaBzable by a signal process very ea^ 

as compared witti the video signal decoding secGon 
1 104 and witti a less memory quantity, so ft is also real- 
15 izable by softwara Also, a pre d etermined vector trans- 
fonraftion may be erTf)ioyed to oblam the nwtion vector 
muftipfied by M/8 HI ttie horizontal direction and tv NAS 
HI tfie vertical (firectioa 

10214] Witti ttvs. ttie (figital broadcast decoding sys- 
20 tem in ttiteembocfirnent can readily dtepteqf a broadcast- 
ing program on a dHlerent cfiannel onto a small screen 

wrttin a main screen diffing and reception of digital 
broadcasts, by having ttie structurally 8iriv)to video si^ 
nal deoo(fing section 1201 in a conventional digftal 
25 broadcast decoding system. 

[021$] ftoct, ttie operation of tfie above-mentioned 
video signal decoding section 1201 will be described 
further in reference to FIQ. 16. 
I0216I FKB. 16 shows a flowchart used to eocplainalgo- 

30 mnm. 

(0217] Inttiefigure, instep l.variable-lengtti decod- 
ing is peribrmed on ttie video signal Stream compressed 
by ttie MPEG standard, whereby ortty ttie motion vector, 

quantization step, and M X N DCT ooeffidents (M 
36 fidents in a horizontal dkection wfiere M is a natoral 
nuiTtier from 1 to 8) are cpctrac t ed. 
(02181 In step 2 ttie DCT coefficients are irwiersely 
(quantized k)y tfie cfuantization step decoded. 
ID2191 In step 3. inverse DCT is peribrmed on ttie Mx 

40 NDCTcotrf fi oertt s . 

{0220] In step 4 the decoded motion vector is multi- 
plied by t4/8 in ttie horizontal direction and by M^ in ttie 
vertical direction, and motion compersation is per- 
formed by employing ttie signal being reproduced and 

46 the previously reproduced signal. 

|q221] h step 5 the motiornximpensated video sig- 
nals are stored t enporarily and (xitput m (fisplay order. 
[0222] By errploying tfie aforementioned algorittvn, 
ttie video signal stream conrf)ressed by ttie MPEG 

50 standard can be readily repnxJuced in a size cl M/8 in 
ttie horizontal direction and 14/8 in tfie vertical (firection. 
[0223] Note ttiat since ttie aforementioned algorittim 
is an ea^ process^ it is realizable by software and can 
also l>e processed in peraM. 

55 [0224] Alsov a predetermined vector tr a nsfan ro tion 
rnay be enployed to obtain the rnotion vector rmdtpKed 
by M/8 in ttie horizontal direction and N/8 in ttie vertical 
(firectioa 
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(Seventeenth EirtxxfmenQ 

[022$I In FIQ. 13 the same reference nunwrals will be 

appfed to the same parts as FKx 11 and therefore a 

deso rip lion thereof is omittBd. 

10226] The essential difference with the errtxximent 

shown in FKa. 11 is that K video signal decoding eeo- 

tionsllll are provided as shown in FIG. 13. 

[0227] Next the operation of this etrtbodunen i wM be 



[p228] AdemodulaSngsecGonllOlperfonnsapfe- 
determB^ demoduialion on a received digital broad- 
cast, thereby generating an MPEQ streann. 
[0229] A separating section 11 02 separates tie video 
and aucfio si^iai compressed streams on a predeter- 
mined channel from the generated MPEQ stream. 
[p23Q] An audb signal decoding section 1109 
decodes the audk> signal compressed stream and out- 
puts an audio signal. 

[0231] Avideosignaldeooding section 1104 decodes 
the video signal compressed stream and ou^xits a 
decoded video signal A. 

[0232] TtieK video signal decocfing sections 1111 
(where K is a natural nuTter equal to or greater than 1) 
decode the video signal oofipressed stream and output 
a decoded video signal a 

[0233] ^ an overlay section 11 18, the K video signals 
B (which Is 1/8 of the video signal A in both horizomal 
and vertical diredkans) reproduced at the video signal 
decoding section 1111 are overlaid at a predetermined 
position on the video signal A reproduced at the video 
si^ decocfing section 1104, and the overlaid signals 
are output 

[0234] Thevideosi^ialdecocfingsectionllll intNs 
entxxfnnent is reafiz^ by a si^ial process very easy 
as conpared with the video signal deoodmg section 
1 104 and with a less memory quantity, so it is also real- 
izable l>y software. 

\p23Sl WHh this, the dgital broadcast decodbig sys- 
tern in this eiiixxiiment can readHy dteptay K Idmis of 
t)ioadcasti n g programs on dSferent charwieis onto a 
smaR screen within a main screen during reception of 
cB^tal txoadcasts, by having the K video signal decod- 
ing sections 1111 in a conventionai distal broadcast 
deoodng system. 

(Eighteenth Embodiment) 

[0236] In FIG. 14 the same reference numerals wH be 
appGed to the same parts as FKB. 12 and therefore a 
description ttiereof is onttted. 
[0237] The essential deference with the errtxximent 
shown in Fia 12 is that K video signal deoodbig sec- 
tions 1201 are provided as sfiown in FIQ. 14. 
[0238] Mexl the operation of this embodimenl wa be 
described. 

[0239] Ademodulating section 1101 performs a pre- 
determined demodulation on a received cfigrtal broad- 



cast, thereby generating an MPEQ stream. 

I024O] A separating section 1102 separates the video 
and audio signal compressed streams on a predeter- 
mined channel from the generated MPEQ stream. 
5 [0241] An aucfio signal decoding section 1103 
decodes tiie aucfio signal coiTf)ressed stream aid out- 
puts an audk) signal. 

tD24q Avldeosi^ialdecoding section 1104 decodes 
the video signal c ompressed stream and outputs a 

w decoded video signal A. 

10249) The K video signal decoding sections 1201 
(where K is a natural number equal to or greater than 1) 
decode the video signal compressed stream and output 
a decoded video signal B. 

16 10244] In an overtay section 11ia the K video si^ttils 
B (wttich is M;8 of the video signal A in tiie horizontal 
droction and N/8 of the video signal A in the vertical 
direction) reproduced at the video signal decocfing sec- 
tion 1111 are overlaid at a prsdeteniined position on 

20 tiievideosignalAreprockJcedattiievideosign^decod- 
ing section 1104. and ttie overtidd si^ials are output 
[024$] The video sipial decoding section 1201 in this 
errtxxfiment is realizable by a signal process very easy 
as compared wHh the video si^ial decocfing section 

25 1 1 04 and with a less memory quantity, so it is also real- 
izable by softwara 

[P248] With ttvs. the (filial broadcast decocfing sys- 
tem In this embodiment can readiy cfisplay K kinds of 
t)roadcasting piugrams on cfifferent cfiannels onto a 
30 smal screen wittiin a main screen during receplkNi of 
(figilal broadcasts, by having ttie K video signal decod- 
ing sections 1201 in a conventional digital broadcast 
ciecocfing system. 

35 (Nineteenth EntxxfimenQ 

[0247] For a digital broadcasting signal storage 
according to a nineteentti emtxxfiment of the present 
invemSoa a description wiB tie made of ttie constitution 
40 andoperatiQninrBierencetoFIG.17.Fiai7illu5irate6 
a biodi dogram of ttie cfigltal broadcasting signal stor- 
age of tills emtxxfiment 

[0248] In the figure, 1701 is a demodulating section. 
1702 a separating section, 1703 memory. 1704awtfia- 

45 ble-lengtti decocfing section, 1705 a variable-lengtti 
enoodmg section. 1706 a multiplexing section, 1707 a 
storage section, and 1708 a storage mecfium. 
[0249] In FKx 18, 1801 is a stream buffer. 1802 a flag 
detector. 1803 a motion vector detector. 1804 a OCT 

50 coefficient detector. 1806 a flag converter. 1806 a 
motion vector oorwerter. 1807 a DOT coefficient thin- 
ning unit, and 1 808 an encoder. 
[0250] The demodulating section 1701 performs a 
predetermined demodulation on a received digital 

56 broadcast. ttieret)y generating an MPEG Stream 

(0251] The separating section 1702 separates the 
video and aucfio signal streams on a 
channel from ttie generated MPEQstreara 
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PI25Z] The memory 1703 stores the auio signal oonh 
pressed stream lempofarHy. 
[02S3] The vwiable4erigithclecodmg section 1 
forms varidbl oto ri gl hdegxfingori the vk^ 
pressed stream and selects and outputs only various 
flags, mobon vectors, and a predetermkied number of 
DCT ooeffcients (M coefifidents ki a horizDri^ 
where M is a natural nuntber from 1 to 8 and N coefVI- 
Gienls in a vertical direction where N is a natural nurit)er 

from 1 toQ. 

[02541 The variab M eng t h e ncoding section 1705 per- 
fomns a predetermi n ed flag tr an sltannBtion (ag.. a 
change in the nmber of horizontd pixels and vertical 
pixels) on me selected various fbgs and also performs 
a motion vector transformation on tfte selected motion 
vectofs. Then, the encocfing section 1705 performs var- 
ial)le-length eiKXidwg on the reeiits of the transforma- 
tions and performs variable-lenglh encocfing on the 
selected predetermrad number of DOT coefficienlsw 
[0255] Here, the varidkMenglh decoding section 
1704 and the variable-iengthenoorfing section 1705 wil 

be descrM in reference to FIGL ia 

[0256] The variable4ength decocKng section 1704 

stores an input stream in the stream buffer 1801 tempo* 

rariy. 

Ha^n The flag detector 1802 detects a flag In the 
stream, then decodes the detected flag, and outputs the 

decoded flag. 

[02Sq The motion vector detector 1803 detects a 
motion vector in the stream, then decodes the detected 
motion vector, and ou^puls the decoded motion vector. 
IP259I The DOT co^fictent detector 1804 detects 
DOT coefficients in the stream, then decodes the 
detected OCT coefficients, and outputs the decoded 
DOT coefficients. 

VJOBCfl In the variaUe4ength encoc^ section 1705, 
the flE^ converter 1805 perfomns a predetermined flag 
tra r glontBtion on various flags and ou^MJts ttie trarsr 
formed flags. 

[0261] The motion vector converter 1806 perfbnm a 
motion vector tianslbnnatlon (&g., ira times In a horh 
zonid direction where M Is a natural nurnber from 1 to 8 
and fM times In a vertical drection where N is a natural 
nunnber from 1 to 8) and outputs the transfonned motion 

vector. 

[0262] The IXrr coefficient thinning unit 1807 outputs 
a pr edeter mi n ed number of DCT coefficients (ag.> hori- 
zontri M pixels and vertical N pixels in a low band com- 
ponent wtiere M and N are a natural number from 1 to 

8). 

(026^ The encoder 1808 variable-lenglh encodes the 
tiansforrned flag, tnansiomiied rnotion i«clor, and a pre- 
determined number of DCT coefficie n t s by a predeler- 
rnmed encocfing code and then outputs thera 
[0264] Also, the muKipleDdng section 1 706 rnJI^^ 
tfie audk) signal compr e ssed stream in ttte memory 
1703 and the video signal compressed stream which is 
the ou^ of the variabMength encoding section 1 706. 
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1026^ The storage section 1707 stores the muW- 
ptesed data in the storage medium 1708. 
nam IMettiatttieflag converter 1805, motion vec- 
tor ooiwerter 1806. and IXTT coefficient Mnning unit 
5 1807 in fHG. 18 are not Included in the variabi»lenglh 
encodtoig section 1 705 but ms^ be Included in the varia- 

bMengfh decoding section 1704. 
(Hvenietii Embodiment) ^ 

10 

|D2i7| In Fia 19 ttie same reference minerals wiU be 

appUd to the same parts as FKl 18 and therefore a 

descriiption tiiereof Is omitled. 

ID26q In fHQ. 19. 1809 is a field detector. 1810 a flag 
15 converter. 1811 a motion vector converter, and 1812 a 

DCT coefficient tNnning unit. 

(0269] Awiable^engtiidecodng section 1704 in this 

embodiment stores an input stream in a stream buffer 

1801 tenrporariy. 
20 fpZTQI A flag detector 1802 d^ects a flag in the 

sIreamL then deoodee the detected flag, and outputs the 

decoded flag* 

IDZni ThefiekJ detector 1809detocts whether or not 
the mac ro block has a field vector and whether or not a 

25 field DCT has been perfonned on the rnacrobtocK and 
outputs tfie resiit of detection. 
[0272] Amotion vectordetector1803detect8amotion 
vector in the stream, then decodes tt^ delected motion 
vector, and outputs the decoded motion vector. 

30 IpaiZl A DCT coefficient d^ector 1804 detects DCT 
coefficients in the stream, then decodes the detected 
DCT codficients, and oulpids the decoded DCT coelf i- 
dents. 

[P274] In a variaUe-lengtii encoding section 1705 in 
35 this eirfoodiment. ttie flag corwerter 1810 performs a 
predetermined flag transform ati on on various flags In 
view of the detection result obtained by the fiM detec- 
tor 1809 and tfien outputs tiie transformed flags. 
[02751 Themotion vector converter 18^1 peribrms a 
40 motion vector transformation (ag.. M/8 times in a tvxl- 
zontal dfrection where M is a natural number from 1 to 8 
and IW times in a vertical direction where N is a natural 

rumtierfrom 1 to 8} when a motion vector fias been 
determined in a frame urtil. Alsa when a motion vector 

46 has been detenmied in a field unit, the rnotion vector 
converter 1811 oonverts ttw motion vector to a frame 
unit t>y a predetermined approodmation metfiod, tfien 
performs a motion vector tra n sfor ma tion (ag., M/B 
times in a hor iz ontal direction where M is a natural 

so nurrfoer from 1 to 8arid 108 tirries in a vertical dhrection 
wfiere K is a natural number from 1 to 8), and oulputs 
ttie transformed motion vector. 
[D27q The DCT coeffiaerit thinning unit 1812 setocte 
only a predeterrraned nuntier of DCT ooeffidente (eg., 

55 fA coelficienis In a ho ria ont a l direction and N ooeff i- 
dents in a vertical drection wtiere M and N are a natural 
nunnber from 1 to 8) wtien DCT coefficients have t>een 
determined in a frame unit Also, when DCT coefficients . 
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havebeend^erriwiedinafieldunit,1heD^ coefficient 
thnvwig unit 1807 deletes one group of DOT ooelfi- 
denlB and oulptJis a pradetennfaied nuntw of DCT 
coefficieniB (M ooefficieniB in a horizontal dfareciion and 
K coefficients in a wtical direction where M and K are 
a natmri nunter from 1 to 8). 
[0277] The encoder1808variable-tongth encodes the 
transtornwadfiag.tra i isfofmedrnoSon vector, and a pre^ 
deternrmd nmbor of DCT coefficients t)y a predeter- 
mined encoding code and then outputs them. 
[0278] Notethatttieftagconverter 1810, motion vec- 
tor converter 1811, and DCT coefficient thinning unit 
1812inFia 19 are not included in the venalMengih 
encoding section 1 705 but may t>e included in the varia- 
l3le4ength decoci^ section 1704. 

(Iwenty-FvBt ErrtxxfimenQ 

[02791 In FIQ. 20 the same reference numerate win t)e 
appied to the same pans as Fia 17 and therekm a 
desoriplion tfiereof is omitted. 
fpSBBOi In rnO. 20, 1901 is a reproducing section, 1902 
a separating section, 1903 an audto signal decoding 
section. 1904 a video si^ decoding section, 1905 a 
vanat3le4ength decoder, 1906 an Inverse quantizer, 
1907 an IDCT unit. 1908 a motion compensator, 1909 
memory, and 1910 a memory controBer. 
[0281] The operation in the aforementioned constitu- 
tion wai hereinafter t)e descri>ed 
10282] The reproducing section 1901 reproduces 
recorded iraitipieKed data from a storage medium 1707. 
[0283] The separating section 1902 s eparates the 
reproduced mUltipleNBd data into video and audk) signal 
oorrpressed streams and then outputs tfie streams^ 
[0284] The audio signal decocfing section 1903 
decodes the aucio signal compressed stream and out- 
puts an audio signal. 

[fOBSi In the video signal decoding section 1904.(1) 
the varicriQMength decoder 1905 variabMenglh 
decodes the atore m entioned video signal conyressed 
stream, and the Inverse quantizer 1906 inversely quan- 
tizes the decoded video signal stream, (2) the l[Xn' unit 
1 907 pertonns an inverse M x N or M k K DCT ^wfiere 
M, N, and K are a natural mirber from 1 to 8), 0) the 
motion compensator 1908 reproduces a video sigial 
from a signal reproduced bf errploying a nK)tion vector 
and also from a signali stored In the memory 1 909, and 
(4) the memory controOer 1910 controls the storage of 
the reproduced video signal to the memory 1909. the 
ou^ of the video signal stored ki the memory 1909 to 
the motion oorrpensator 1908, and the ou^ of the 
reproQucea voeo Signal. 

[02881 In accor dan ce with tttis embodiment, if DCT 
coefficients are thinned out, an amount of dato to to 
stored can l^e reduced and the speed of requisito ddAa 
can t)e stowed dowa 
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(liMenty-Second Embodiment) 

102871 In Fia 21 ttie same reference numerals will be 
apptied to the same parts as FIQ. 17 and therefore a 
descnption thereof is omitled. 
[0288] In RQ. 21, 2001 is a video signal decoding sec- 
tion. 2002 a variatsle-length decoder, 2003 an inverse 
quantizer, 2004 an |[Xrr urut, 2005 a motion compensa- 
tor, 2006 memory; 2007 a memory controOer, 2008 a 
video signal encoding section, 2009 a fatering unit, 
2010 memory; 2011 a memory controller, 2012 a differ- 
ential signal generator, 2013 a DCT unit, 2014 a quan- 
tizer, and 201 5 a variak)to4ength encoder, 
{D2rai The operation in the aforementioned constitu- 
tion win hereinafter be descri)ed. 
Vaan In the video sic^ decoding section 2001,(1) 
the variable-length decoder 2002 variatale-length 
decodes a video stgnsA compressed stream, and the 
inverse quantizer 2003 inversely quantizes ttie decoded 
video signal stream, (2) the IDCT unit 2004 perfbmns an 
nverse OCT, (3) the motion compensator 2005 repro- 
duces a video signal lirom a signal reproduced t>y 
enfv)toying a rmtion vector and also from a signal stored 
in the memory 2006, and (4) ttie memory oonlroner 
2007 controls the storage of the reproduced video sig- 
nal to the memory 2006, ttie output of ttie video signal 
stored in the memory 2006 to ttie motion oonrpensator 
2005, and ttie output of ttie reproduced video signal. 
[02911 On ttie ottier hand. In ttie videos!^ encoding 
section 2008, the fStering unit 2009 perfomns a pred e- 
temmed filtering operation on a video signal which is 
ttie output of ttie video signal decoduig section 2001, 
ttiereby changing ttie resolution of the video signal. 
10292] The memory controller 201 1 controls ttie stor- 
age of ttie fttered video signal to ttie memory 2010, ttie 
output of ttie video signal stored in ttie memory 2010 to 
ttie (Kfferential signal generator 2012. and the output of 
ttie fStered video si^ial. 

[0293] The differential signal generator 2012 changes 
ttie motion vector decoded at the video signal decocfing 
section 2001 so ttiat ttie motion vector is suitafc)le to ttie 
reproduced video signal after the aforementioned flter- 

ing operation, ttiereby generating a differential signal 
[0294] The DCT unit 2013 performs DCT on ttie differ- 
ential signal. The quantizer 2014 changes the quantiza- 
tion step decoded at ttie video signal decoding section 
2001 so ttiat ttie quantization step is suitable to ttie 
reproduced video signd after the aforementioned fiter- 

ing operation and ttie data rate after compression, and 
ttien performs quantization t)y utilizing ttie cfianged 
quantization step. 

|029q The veriafale^engtti encoder 2015 perfiomns 
varlab tole ng tti encoding on ttie quantized data and var- 

ious attadied data. 

[0296] Ho/tB ttiat ttie nineteentti ttvough ttie twenty- 
second enrtediments are realizable k^y softrara 
[0297] Witti this, even kittle case where video signals 
in various formats (resolution, frame frequenqf, eto.) 
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were input, video signals can be readily stored in or 
reproduced from a storage medMn as a single furriuL 
[0298] While the present invention has been 
descnbed ¥vith reference to the preferred entxxfimeris 
thereof, the invention is not to be limited to the delais 5 
given herein, but may b& nvxified within the scope of 
tfie appended claims. 

Claims 

1. A mettled of layering and encodmg an input video 
signal on the basis of spatial resolulionp con^prising: 

Tifst resoAJDon translDrmaBon step or gener- 
ating a second video signal with low resolution is 
from a first video signal with Ngh resolution 
which is said input video signal; 3^ 
a first enoocfing step of encod w g said second 
video signal; 

a deoodmg step of decodng the encoded sec- a> 
end video signal; 

a second resolution liuf ibfuiiiiUUun step of gen- 
eraling a thiid video sigrmi wAh tfie same high 
resolution as said first video signal, tnsed on 
the decoded video si^ial obtained by deoodmg 2S 

said second video signal; 
a second encoding step of encoding a video 
si^ial with tfie same hi^ resolulion as said 
fiist video signal, obtained based on said fiist 
video si^idl and said third video signal; so 
ahiflhftrequenqfcoiiponenti ito r mat ionomput 
step of ou^xjliing inlbnnnBtio n on a Mgh ff^ 
quency component wfach is included In said 
first video signei or said second video signal; 
and 35 
an encoding quantity control step of controHing 
an erxxxf ng rate at wtiich said second video 
signal is encoded by said first erxxxing step 
and an erKXxSng rato at M«ch said firet video 
signal is encoded by said second e noodwig 40 
step^ t)ased on the output fii^ frequency com- 
ponent infbrmalioa 

2. An apparatus for layering and encodrng a video sig- 
nal on tfie t>a6is of spatial resolution, comprisffig: 46 

fBSt resolulion trvistormation meare to gener- 
ate a second video signal with low r e sol u tion 
from a fiist video signal with Ngh resolution 
wfiich is an input video signal; so 
fust enoodw g meam to encode said second 
video signal; 

decoding means to decode the encoded sec- 4. 
ond video signal; 

second resolulion transformation meere to ss 
generate a frvrd video signal w^ tfie same res^ 
okjtxxi as said first video signal from ttie 
decoded video signal d said secorvi video sig- 
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nal; 

second encoding means to encode said first 
video signal, based on a time axis correla6on of 
the first video signal and based on said thwd 
video signal as a predcted video signal; 
frequency distrtxition measuring means to 
measure a frequency distrtaution of Said first 
video signal; and 

.encoding quantity control means to control an 
encoding rale at which said second video sig- 
nal is encoded by said first encoding means 
and an encoding rate at which said first video 

signal is encoded by said second enoodmg 
means, based on the measured frequency (isr 

tnbution. 

An apparatus lor layering and encocfng a video sig- 
nal on the basts of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolulion 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode said second 
video stgnal; 

decoding means to decode the encoded sec- 
ond video stgnal; 

second resolution tra n sformation means to 
generato a ttiird video signal with ttie same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; 

dHierential signal generating means to gener* 
ate a fourth video signal which is a dilfBrential 
stgia) between said first video signal arKf said 
ttwd video si^ial; 

motion detection means to detect motion from 
said first video signal; 

second encoding means to encode said fourth 
video signal, t>ased on the detected motion of 
said first video signal; 

frequency distrbutkm measuring means to 
measure a frequency distrisution of sidd fist 
video signal; and 

encoding quantity control means to control an 
encoding rate at wfiich said second video sig- 
nal is encoded by said first encodfaig means 
arvl an enoocfing rate at wfiich said fourth video 
signal is encoded by said second encodbig 
means, t>ased on the measured frequency d»- 
tnounon. 

An apparatus for layering and encoding a video sig- 
ral on tfie tXBis of spatial resoliition, cuniMising: 

first resolution transfor ma tion means to gener- 
ate a second video signal with low resolubon 
from a first video signal with fngh resolution 
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18 an input video signal; 

first encoding means to encode eald second 
video signal; 

deoocfing means to decode the encoded sec- 
ond video signal; 

second resduticn tr a nslDnnaion means to 
generate a third video signal with the same res- 



as said fvst video signal from the 
decoded video signal of said second video sig- 
nal; 

motion detection means to detect motion from 
said second video signal; 
second encod ng means to encode said first 
video signal, tMsed on a time axis corre la lion of 
the fvst video signal and based on said third 
video signal as a predcted video signal; and 
enoodng quanlil/ control means to control an 
encoding rate at which said second video sig- 
nal is encoded tiy said first encoding means 
and an enco di ng rate at wtuch said fast video 
signal is encoded tjy said second encodng 
means, based on the detected motion off 
second video 



5. An apparatus tx layering ^encoding a video sig- 
nal on the basis off spatial resohilion, oonv)nsing: 

first resotution transformation means to gener- 
ate a second video signal with low resolution 
from a first video siyial wHh high resolufion 
wtiich is an input video sigral; 
first encodng means to encode said second 
video signal; 

deoocfing means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video si^iat with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; 

motion detection means to delect motion from 
said first video tignal; 

second erKxxing means to encode said first 
video si^ial, t)a5ed on a time axis correlalion of 
the first video signal and based on said ttwd 
video signal as a pradcted video signal; and 
encodng quantity cortrol means to control an 
encodng rate at which said second video sig- 
nal is encoded ttjf said firel encodng means 
and an encoding rate at which said first video 
signal is e n coded Isy said secorvt encodbig 
means, based on the d et ect e d motion off said 
first video signal. 

S. An apparatus for layering arvl encodng a video sig- 
nal on the tsasts of spetiaJ resolution, comprising: 
first resolution trarvtonfcrtion mear» to generate a 
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second video si^ial with low resdution from a 
first video signal with high resolution wNch is 
an input video signal; 

first encodng means to encode said second 
video signal; 

decodng means to decode the encoded sec- 
orK) video sigrial; 

second resolution transfonnalion means to 
generate a ttwd video signal with tfie same res- 
otution as said first video signal from the 
decoded video signal of said second video sig- 
nal; 

dHierential signal generating means to gener- 
ate a fourth video agnai which Is a differential 
signal t)etween said first video signal and said 
ttwd video signal; 

motion detection mear« to detect motion from 
said first video signal; 

secord encoding means to encode said fourth 
video signal, based on the detected motion of 
said first video slgmtf; and 
encoding quantity control means to control an 
erxxxling rate at wfiich said secorvl video sig- 
nal is encoded tiy sad first encodng means 
and an encoding rale at which said fourth video 
signal is encoded by said second erKxxfing 
mem. based on the detected motion of said 
first video signal- 

An apparatus for layering and encodng a video sig- 
nal on tfie basis of spatial resohJtion, comprising: 

first resohJtion transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
iM^iich is an input video signal; 
first encodng means to erx»de said second 
video signal; 

decoding means to decode the encoded sec- 
orvl video signal; 

secord resototion transfo rma tion means to 
generate a third video signal with tfie same res- 
olution as said first video si^^ from tlie 
decoded video signal of said second video sig- 
nal; 

motion detection means to detect motion from 
said secorxJ video signal: 
second encoding means to ercode said first 
video signal, t)ased on a time axis correlation of 
the first video signal and based on said third 
video signal as a predicted video signal; fre- 
quency dstribution measuring means to meas- 
ure a 

frequency dstrtxition of said first video signal; 
and 

encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encodng means 
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and an enooding rate at which said firet video 
si^iai IS encoded oy said second enooong 
meanSk based on the delected fre(|uencydblih 
buHon and the detected inoHon off said second 
video signal. 

& An appmdus for layering and enoodkig a video sig- 
nal on the k)asis of spatial resolulion, oon^vising: 

first resolution transformation means to gener- 
ate a second video sigral with low resolution 
from a first video signal with Mgh resolution 
which is an irput video signal; 
first enooding means to encode said second 
video signal; 

decocing means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal fcom the 
decoded video signal of said second video sig- 
nal; 

motion detection means to detect motion linom 
said first video sig^; 

second encoding means to encode said first 
video signal, t)ased on a time axis correlation ol 
the first video signal arvJ t>a6ed on said ttwd 
video signal as a precfictad video signal; 
frequency distrixJtion measuring means to 
measure a frequenqr distribution of said first 
video signal; and 

enooding quantity control means to control an 
encoding rale at wNch said second video sig- 
nal is encoded ty said first encodbig meers 
andanenooc^ rate at wtich said first video 
»gna] is encoded by said second encodmg 
means, based on the detected frequency distri- 
bution and the detected motion of said first 
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between said first video si^ial and said 
third video signal; 

motion detection means to detect motion tom 
said first video signal; 

second encodflig means to encode said fourth 
video signal, based on the detected motion of 
said first video signal; 

frequency distribution measuring means to 
measure a frequency dtetnbution of said fwst 

encodng quantily control means to control an 
encoding rale at«4iich said second video sig- 
nal is encoded by said first enooding means 
and an encocfing rate at wfiich said fourth video 
signal is encoded by scad secord encoding 
means, based on the measured frequency dis- 
tribution and the delected motion of said first 
video signal. 

ia Ihe apparatus as set forth In datm 2, 3, 7, 8^ or 9, 
wfieroui! 

said frec^jency distribution measuring means is 
(fistribution detection means employing a high- 
pass filter; aiKl 

when a hi^ frec^iency component in said fre- 
quency distribution is small, said encoding 
quantity control means increases the erKxxfing 
rate at wtiich said secord video signal is 
encoded. 

11. Ihe apparatus as set forth in daim 2. 3, 7, 8^ or 9. 
wfier^n: 



40 

9l An apparatus for layering and encodwig a video sig- 
nal on the basis of spatial resohition, conprising: 

first resolution trarslbrmation means to gener- 
ate a second video signal with low resolution 45 
from a first video signal with high resolution 
wtvch is an input video st^ial; 
fRSt encocfing means to encode said second 
video signal: 

decoding means to decode the encoded sec- 50 
ond video signal; 

second resolution transformalion means to 
germate a tfiird video signal with tfie same res^ 
olution as said first video signal from the 
decoded video signal of said second video sig- ss 
nal; 

deferential signal generating means to gener- 
ate a fourth video signal wfvch is a dHferential 



said first resolution transformation 
resolution transformation me^is employing a 
low-pass filter whose frequency characteristic 
Is expressed by F; 

said frequency cfistnbution measuring means is 
distribution detection mears employing a higlv- 
pass filter in wtuch said fnst video signal is 
expressed wHh a frequency ctiaiacterisfic of 1 - 
Rand 

wfien a higjh frequency component in said fre- 
quency cfistribution is smaR. saM encodfrig 
quantity control means increases the encodKig 
rate at wfiich said second video si^ial is 
encoded. 

12. Ihe apparatus as s^ forth in daim 2, 3, 7. 8, a 9. 
wfierein: 

said frequency dtetribution measuring means is 
means for detecting the absolute value sum of 
a cfinerence t>etween a fifth video signal gener- 
ated from said second video signal by employ- 
ing said second resolution transformation 
mear« and said fvst video signal; and 
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when saki abeoliite value sum is smaRp sad 
encndng qyanfily oonlrol meane jncraoseG the 
encoding ralB al iRMch said second vicleo sig- 
ned is encoded. 

13. The apparatus as set forth in daim 2, 3. 7, 8. or 9, 
wherein: 

said frequency dtelrtxjten measuring ineans is 
means tor detecting the dtsedulB value sum of 
a d afwe nce between a fifth video signal gener- 
ated from said second video signal by employ- 
ing 8»d second resolution transformation 
means and said fkst video signal, and wtwn an 
absolute value of said diflerence is equal to or 
less than a predetermined threshold value, 
said frequency ( fe trib u tion measuring means 
adds 0 instead of adding said absolute value; 
and 

when said absotuta value sum is smal, said 
encoding quantity control means increases the 
encoding rate at which said second video sig- 
nal is encoded. 

14. The apparatus as set forth in dalm 4, 5. 6, 7, 8, or 
9, wherem, when the detected motion of said first 
video signd is great, ihe encoding rate at which 
said second video signal is encoded is increased. 

15. The apparatus as set forth In danm 2, 4, 5^ 7, 8» 10, 
11 , 12, or 13, vi4ierein the sum of the enoodbig lale 
at which said fifst video signal is encoded and the 
encocfing rate at which said second video signd is 

encoded Is fixed. 

16. The apparatus as set forth in daim 3, 6, % 10, 11, 
12. or 13. wherem the sum of the erxxxfing rate at 
which said first vidso signal is encoded and the 
encoding rate at which said fourth video signal is 
encoded is fixed. 

17. A method of layering and encoding an input video 
si^ial on the basis of spatial resoMlon, comprising: 

a first resolution b ar gionnation step of gener- 
ating a second video signal with low resolution 
from a first video signal with high resolution 
which is said input video sigral ; 
a first enoocfing step of encoding said second 
video signal; 

a deoodmg step of deoodtoig the encoded sec- 
ond video signal: 

a second resolulion transformation step of gen* 
erating a third video signal with the same Ngh 
resolution as said first video signal, based on 
the decoded video signal obtained by decoding 
said seooTKl video si|^; and 
a second encoding step of enoodkig said first 



video signal, based on a pbjrality of encode 
modes; 

wtierein, when in said second encoding step 
said encoding is perfonned by enfrfoying an 

5 encode mode based on bidirecHonaipreciction 

In a tirw axis direction among said plurality of 
encode modes, only information incficating 
which of said first video signal or said decoded 
video signal is utifized by the encoding in sad 

10 first encod in g step or enoocSng in said second 

en c odin g step is encoded. 

1& An appBmfti» for layering and encodwig a video sig- 
nal on the basis of spatial reaoimion, co m pris in g: 

IS 

first resolidion trroiormation means to gener- 
ate a seoorxJ video signal with low resdulion 
from a firet video si^ with hi^ resolulion 
wfich is an input video signal; 
20 first encoding means to encode said second 

video signal; 

decoding means to decode the encoded sec- 
ond video signal; 

second resolution transfonmtion mear« to 
25 generate a tfnrd video signal with the same res- 

olution as said first video signal from the 
decoded video signal off said second video sig- 
nal; and 

eecorvf erxxxing means to encode each frame 

30 of said first video signal by at least one of the 

encode modes among (1) spatial inter-resolu- 
tion predictive oocfng which ernptoys precficlion 
in a spatial axis cfiredion employing said thiid 
video signal, (2) intraframe coding which 

» employs only data within said fiame, (3) inter- 

. frame forward predictive coding which employs 
forward precMion in a time axis drection. and 
(4) Interframe bidlreclional precSctive coding 
wIMi enY)loy8 bidirectional prediction m ifie 

40 timeasdscfirectiorr. 

wherein, when said Interframe bidirectional 
predtefive coding is periormed by said second 
encoding means, or^ a motion vector obtained 
by interframe kMdirectional prediction is 

45 encoded. 

ia An appaialus for layervig and erxxxing a video sig- 
nal on the t)asis of spatial resoMion, comprising: 

so first resolution tr an sformation mewis to gener- 

ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode each frame off 

SB said second video signal t)y eitfier (1) intra- 

frame coding which enrptoys only data within 
said trame. (2) irrterframe fbrwaid predk:6ve 
codmg which employs fon^mf prediction in a 
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time axis dvedion, or 0) imeitame bidirac- 
ttOfiBl predidivo coding which employs bidveo- 
lioniri precficlion in the time axis dheclion; 

deoGcfing means to decode the encoded sec* 
ond video signal; s 
second resolution transfonnatoi means to 
generate a thiid video signal with the same resr 
oMon as said first video signal from the 
decoded video signal off said second video S9- 
nal;and io 
second encoding means to encode each frame 
of said first video signal by at least one off the 
erKXxJe modes among (1) spatial Riter-resolu- 
tion predk:tive oodfang which employs prediction 
in a spatial axis direction employing said third i5 
video signal. (2) intiaframe coding which 
employs only data within said frame, (?) inter- 
trame forwaid predictive oocing which ernploys 
fonMard predidion in a time axis direction, and 
(4) imerflrame bi J redio na l predkilive coding so 
which enrploys bidrodionBl predtolion in the 
time axis direction; 

wtierein, wffien said interlrame bid^ectioral 
predictive coding is performed by said second 
erxxxfingmeans^orily a motion vector obtained 25 
by intertrame bidirectional prediction is 
encoded. 

20. The apparatus as set forth In daim 19. wherein, 
when saidfirstencodfog means performs said intra- » 
frame coding, said second erxxxing means 
encodes a frame corresponding to the frame by 
said irttrafirame coding. 

21. The apparatus as set forth in daim 19, wherein, as 
wt)en said first encodhig means performs said inter- 
frame bidirectional predictive coding, said second 
encocfing means encodes a frame correspondng to 
the frame by ehher said intraframe coding or said 
intertrame forwanlpredicfive coding. 4o 

22. Hie appmSus as set forth in daim 19, wherein, 
wtien said first ericndmg nriears perfbrrrs said iritra- 
frame coding, said second encocfng means 
encodes a frame corresponcfing to the frame by 46 
only said spatial inter-resolution precBctive oodwig. 

2X The apparatus as set forth in daim 19, wherein, 
wffien said first encoding means performs either 
said iitoli am e ioiwaid predfolive codfoig or said so 
interframe bidirectional pnxiclive oodmg, said sec- 
ond encoding means utfiaESS a motion vector 
obtained by rnuRiplymg tffie inotion vector detected 
at said first enocxin g mear« by a predetermmd 
nmberarxJ encodes a frame correspondng to the ss 
frame encoded by said first encodtog means with 
the same encode mode as tffieencxxie mode off said 
fRSt encoding means. 



a4w The apparatus as set forth in daim 23, wherein said 
second encoding means does nd encode the 
motion vector obtained tyy multiplying the motion 
vector detected at said first encoding means by a 
predetermined nurrfoer. 

2& An apparatus for layering and encoding a video sig- 
nal on the basis off spatial resolution, comprising: 

first resohJlion transformation means to gener< 
ate a second video signal with low resdution 
from a first video signal with Mg^ resdution 
which is an input video signal; 
first encod ng means to encode said second 
video signal: 

deoo(fing means to decode the encoded sec- 
orvl video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
dutibn as said first, video signal from the 
decoded video signal of said second video sig- 
nal; and 

seoorxiencocftig moo n s to encode each frame 
of said first video sigrai by at least one d the 
encode modes among (1) spatia] inter-resolu- 
tion precfidive codng which erTV)loys precfidion 
in a spatial axis cSredion errploying said tNrd 
video signal, (2) intraframe coding which 
employs only data wHfun said frame, (3) tnter- 
frarne forwaid precfidive oodHig wffiich emplcys 
forward prediction in a time axis direction, and 
(4) interfr a me bidrodional predictive coding 
which employs bidir e ctiona l predfotion in the 
time axis drection; 

wherein said second encoding means encodes 
frames of said first video signal at intervals of a 
predetermined nurrfoer of frames by said spa- 
tial inter-resolution predictive coding alona 

20. An apparatus for layering and encodng a video sig- 
nal on the basis of spafial resoMion, coinprising: 

first resdution trandbrmation means to gener- 
ate a secorvi video signal witfi Im resdution 
from a fvst video signal with high resolution 
whid) is an input video signal; 
fret encodng means to encode said secorKi 
video signal; 

decoding means to decode the erxxxled sec- 
ond video signal; 

second resolution transform a tion means to 
generate a third video signal vMth the same res- 
olution as said finst video signal from the 
decoded video signal of said second video sig- 

second encodfog means to encode each frame 
of said first video signal by a! least one d ttie 
encode nrvxies among (1) spatial toter-resdu- 
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lion predwtive ooding which en«^^ 
in a spatial axis dbeclion eirploying said 1^ 
video signal, i n lr a fia n ie oodmg which 
enploys only dato within said frame, (3) inter- 
frame IbnMard predictive oodn^ 5 
forward precfiction in a lime axis di re clioa and 
(4) Interframe t)i(ireGtional predkrtive codkig 
which empkifB tM reclional predtelion in the 
tmne a»8 direction; and 

fnotkxn vector detection means to detect a io 
motion vector between frames of said ffiret 
video signal; 

wherein said second encoding means per- 
forms encocfing l>y employing the motion vector 
detected bf said motion vector detection is 
means, and said first enoocfing means per- 
fbnnrs encoding tsy einploying a inolion vector 
otJiained tv muHqplying the motion vector 
detected at said motion vector detection means 
tiy a predetermined vurrber, so 

27. The apparatus as set forth in claim 26, wherein 
either said second enoodffig means or sad firGt 
enoodmg means encodes either the motion vector 
detected t)y said motion vector detection means or 2s 
a motion vector otitained t)y dividing the motion 
vector detected at said motion vector detection 
means tv a predetermined njmk)er. 



video signal on the t)BSis of spatial resolution, com- 
pnsmg: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which IS said input video signal; 
first encoding means to encode said second 
video sig^; 

decoding means to decode the encoded sec- 
orvf video signal; 

second resototion transformatton means to 
generate a third video signal with the same 
high resduten as said first video signal, tiased 
on the decoded video signal ctTtained by 
decoding said second video signal; 
OHure n tial signal generation means to com- 
pute a data difference between frames of said 
first and third video signers which correspond 
with each other aril generate a ( fi f fe ren Ual sig- 
ral; 

band dKriding means to divide the generated 
dfflerential signal by 6»d differential signal gen- 
eration means into a p^ity of predetermined 
t>andsarvJ generate a tNUidcfivicfing 8i9ial;arvl 
second enoocfing means to encode said band 
(ividfrig signal generated by said band (Svidfrig 
mearsw 



28. A method of layering and encoding an ir^xit video ao 3a A digital broadcast deooifing method ddecodmg a 
si^ on the basis of spatial resolution, cunpris in g: broadcasting signd cornpressed by ttie Moving Pic- 
ture Ei^ierts Grotp (MPEG) standard and mulfi- 

a first resolution fransformation step of gener- piexed. comprising: 
ating a second video si^ial with low resolution 

from a first video signal with high resolution » a demodiJation step of pertomwg a predeter- 

which is saklirput video signal; nwied demodulation on sad broadcasting stg- 

a first encoding step of encoding said second nal; 

videos!^; a separation step of separating the demodu- 

a decoding step of decodmg the encoded sec- lated broadcasting signal into a video signal 

ond video signal; 40 compressed stream arxf an audio signal oom- 

a second resolution transformation step of gerv pressed stream on a first channel; 

erating a third video signal with the same high a first video signal decoding step off decocSng 

resolution as said first video signal, based on the separated video signal conpressed stream 

the decoded video signal obtained by decodmg present on said first channel; 

said second video st^ial; 45 a first audio signal deoo(fing step di deoocfing 

a differential signal generation step of comput- the separated audio signal oorT|)res8ed stream 

Ing a data difference between frames of said present on said first channel; and 

firat and third video signals wNch correspond a second video signal decocting step off decod- 

with each other and generating a di ffer e nt ial frig a video signal cornpressed stream present 

signal; so on a second channel different from said first 

a band dhMng step of dKMng the generated channel: 

dflerenlid signal into a pluraity of predeter- wherefri in said second video signal decodfrig 

mined bands and generatfrig a band dmfng stepi (1) the video signal conprassed stream 

signal; and on said second channel is decoded, (2) a 

a second encoding step of encodng the gener- ss motion vector, and a DC conrponent in DOT 

atedtnnddMding signal. coeffiderits are extracted, or a DC oornponent 

and some of DCT coefficients axducfing the DC 

29. An apparatus for layering and encoding an frput conrponent are exfracted, and (3) based on the 
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exbBclBd contents, 8^ sooond video signal is 
decoded. 

31. A dighal broadcast decoding apparatus for decod- 
ing a Imadcasting siganal which is generated from 
a video signal and an aixio signal which are com- 
pressed by the Moving Pidire Experts GnMp 
(MPEQ) siandanJ, muHiiplGNed and modutated, 
U )i i|xi bin g: 

a demodulating section to perform a predeter- 
mined demodidation on said digital broadcast- 
ing signal: 

a separating section to separate the demodu- 
lated broadcasting signal into a video signal 
oonpressed stream and an audk) signal com- 
pressed stream on at least one channel tsy 
releasing said mifiplexing; 
a first video signal decoding section to decode 
the separated video signal compressed stream 
present on a predetermined diannel; 
an aufio st^rai decoding section to decode ttie 
separated aucSo signal compressed stream 
present on said predetermined cttannel; 
a second video signal decodmg section to 



decode a video signal oo r npressed stream 
present on a channel other than said predeter- 
mined channel and to output the decoded sig- 
nal; and 

a video signal overlaying section to overlay a 
video signal output of said second video sicpia) 
deco(fing section at a predetermined position 
on a video stgnal output of said first video sig- 
nal decoding section and to output the Mrtaid 
signal; 

wherein said second video signal deoodmg 
section has: 

a varlabla4englh decoder vMch (1) variable- 
length decodes said video signal oonviressed 
stream, (2) eodrads a motion vector and a DC 
conponent, or (3) extracts a quanlizafion step 
when said DC conponent is c^^iantized, the 
quantizaAion step being a dhosor enployed in 
the quantization; 

inverse deferential pulse code modulation 
(DPCM) unit to perfonn inverse DPCM only 
when DPCM has t)een perfonned on said DC 
component; 

an inverse quantizer to puluni inverse quanU- 
zation only iiitfien said DC component tias t)een 



a memory oontroOer to control, writing off data to 
said memory and reading of data from said 
memory. 



32. The digital broadcast decatfing apparatus as set 
forth iri ctedm 31 , wherein said predetenrvted trans- 
tonnation is to mult9)ly said motion vector by 1/8. 



33, 



10 



IS 



20 



30 



36 



40 



46 



60 



memory to Store ttie decoded video signal; 
a motion oomperreator to oomper g ate motion 
by cmptoyingtwth a video signal corrp e n sa t e d 
and decoded after sakJ motion vector has been 86 
transiprmed by a predetermined transforma- 
tion and a video signal stored in said memory; 
and 



A digSal broadcast decoding apparatus for decod- 
ng a broadcasting siganal which Is generated from 
a video signal and an audio signal which are com- 
pressed by the Moving Picture Experts Qroup 
(MPEG) standard, multiplexed and modulated, 
comprising. 

a demodulaling section to perform a predeter- 
mined demodulation on said digital broadcast- 
nig signal; 

a separating section to separate the demodu- 
lated broadcasting signal into a video signal 
oonpressed stream and an audio signal com- 
pressed stream on at least one channel by 
releasing said multiplexing; 
a first video signal decoding section to decode 
the separated video signal oonpressed stream 
present on a predetermined channel; 
an audio signal decodng section to decode the 
sep ar ated audfo signal compressed stream 
present on said predetemwned channel; 
a second video signfll decoding section to 
decode a video signal compressed stream 
present on a channel other than said predeter- 
mined channel and to output the decoded sig- 
nal; and 

a video signal overlaying section to overlay a 
video signal output of s^ second video sigral 
decocfing section at a predetermined position 
on a video signal output of said first video sig- 
nal decodffig section and to output the overlaid 
signal; 

wherein said second video signal decoding 
section 



a variable-length decoder wtvch (1) variable- 
length decodes said video signal compressed 
stream and (2) extractB a motion vector, a 
quantbiBtion step wttich is a cfivisor employed in 
quantization, and M X N DCT coefficients con- 
sisting of M coefficients in a horizontal ejection 
(where M is a natural numtier from 1 to 8) and 
N coefficients in a vertical direcfion (where N is 
a natural number from 1 to 8); 
an inverse quarrtizer to quantize said M x N 
DCT coefficients inversely; 
memory to store the decoded video signal; 
a motion compensator to conrpensate motion 
by employing both a video signal conpercated 
and decoded after said motion vector has been 
trarofdrmed In iKirizontal and vertical direc- 
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tens a predelemiined tFBittlom 

video si^ial stored h G»d memory; and 

a memory controller to oontvDl writing of data to 

said memory and reading of data from said 

memory. s 

34w Tlie (figilal broadcast decoiding apparatus as set 
forth in dalm 33, wherein said predelernme^ 
fomiation 18 to mulMy said motion vector by M» in 
the horizontal direction and M/B in the vertical dkeo- io 
tion. 

35. The cfigitd broadcast decoiding apparatus as set 
forth in claim 31 or 33, wherein said second video 
signal decoding section oonprisesK second video is 
decoding sections where K is a nature number 
equal to or greater than 1 and wherein said video 
signal overtaymg section overlays video ^gnal out- 
puts of said K second video si^nl decoding see- 
tions at a predetermined position on a video signal 20 
output of said first video signal decoding section 
and then outputs the overiaid signal. 

36. A system for decocfing a video si^ial on which a 
predetermined encoding operation has been per- 2s 
formed, ooinpriang: 



varial3le-lengtti decodng means which wia- 
bMengtii decodes a video signal compressed 
stream and adracts a motion vector, a quanti- 
zation step which is a divisor employed in 
quantization, and M x N DOT coefficients con- 
sisting of co^fidenls in a horizontal (firection 
(wtiere M is a natural rajmber from 1 to 8) and 
N coefficients ffi a vertical (tirection (where N is 
a natural nunrtber from 1 to 8); 

inverse quantizing means to quantize said M x 

N fXTTooefficients irwersely; 

memory to store a decoded video signal; 

a compensator to corrpensato motion t)y 

employnng bdh a video signal oonpens a led 

and decoded after said motion vector has t>een 

transformed in honzontal arvJ vertical cfirec- 

tiorg ty a predetermred tra n sfbrmation and a 

video signal stored in said memory; and 

a memory controller to control writing of data to 

said memory and reading of data from said 

memory. 

39l The system as s^ forth in claim 38, wherein said 
predetermined transformation is to multiply said 
motion vector by M/8 in the iKXizontal cirection and 
fW in the vertical directioa 



IS 



so 



a variable-lengtii decoding meana wfiich (1) 
variab to l en gt h decodes a video signal com- 
pressed stream, (2) ortracto a motion vector so 
and a DC component, and (3) extracts a quan- 
tization step 9 said DC component is quan- 
tized, the c^iantizatibn step being a cfivisor 
employed in tiie quantization; 
inverse differential pulse code modulation as 
(DPCM) means to perform inverse DPCM orfy 
when DPCM has been performed on said DC 
component; ^ 

means to perform inverse quantization only 
when said DC confxmnt has t>een quantized; 40 
menmy to store a decoded video signal; 
a compensator to conper»ate motion by 
employing txHh a video signal conpensated 
and decoded after said motion vector has t)een 
transformed by a predetermined traretorme- 4S 
tion and a video signal stored in said memory; 
and 

a memory controller to control writing of data to 
said memory and readvig of data from said 
memory. so 

37. The system as set Ibrlh in daim 36. w^ierein said 
predetermined transformation is to multiply said 
motion vector tiy 1^ 

SB 

38. A ^stem for decoding a video si^ial on which a 
predetermined encodmg operation has t>een per- 
formed, coirvirising: 



4a A di^ broadcasting signal storing method of 
receivvig and storing a broadcasting si^vri com- 
pressed by tiie Moving Picture Experts Group 
(MPEG) standanf and muitipleNed, conprisi n g tiie 
steps of: 

receiving said broadca^ng signal and per- 
forming a predetermined democtolation; 
separating a video si^ial oorrpressed stream 
from tiie demodulalBd broadcasting signal; 
decoding the sep ar at e d video signal com- 
pressed stream; 

based on a pre d etermined flag jn tiie decoded 
stream, andftx t)ased on a predetemined 
motion vector and predeterm in ed DCT coeffi- 
cients in tfie decoded stream, (1) converting 
various formats in said decoded stream to a 
predetemined format andAor (2) reducing the 
data amount of sad decoded stream, and then 
(3) encodtog said decoded stream; and 
storing tiie erooded stream in a predetemined 
storage mecfum 

41. A digtel t)roadcasting signal storage for storing a 
broadcast compressed tiy the McMig Picture 
B^ierts Group (MPECO standard, comprising: 

a demodulating section to perform a predeter- 
mined demodulation on a digital broadcast 
vMch is tmadcasted by con pr e s sin g a video 
si^ial and an audio sigiial by ttie MPEG stand- 
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aid aid peftaming predelerin^ 
and modUlalion on Ihe video and audto 
a eeparating section to separate video and 
aucio signal compressed streams on a prede- 
temvned channel by releasing said predeter- 
nined muHv^lodng: 

memory to store ttie sep arated audk) signal 
oonprKsed stream temporarily; 
a variabMength decoder to perform variable- 
length decocBng on the separated video signal 
oorrpressed stream and to select various flags, 
motion vectors, and a predetemined nunnber 
of DOT ooefficienls (M coefficients m a horizon- 
tal diredion where M is a natural numl)er from 
1 to 8 and N coefficients in a vertical dvection 
where N is a natural nunt)er from 1 to 8); 
a variable-length encoder to peifonn variable- 
length encoding on the selected various flags 
and motion vectors, by perfenming a predeter* 
mined fteg transtormation on the seleclBd vBrv- 
oue flags and also performing a motion vector 
transformation on the selected motion vectors; 
a rniJtipl€Ddng section to rnuHiplac the variable- 
length encoded video signal data and said 
audio signal compressed stream; and 
a storage section to store the muMplexBd data 
in a predetermined storage medkjm. 



variable- 45 



termnied channel by releaang said predeter- 
mined irtdtipleDdng; 

memory to store the sepaiated audto signal 
compressed stream terrporarfly; 
a variable-lenglh decoder 
length decodes the separated video signal 
compre ss ed stream and seleclB^wrious flags, 
(1) performs a motion vector transformation 
when a motion vector has t)een detenrined in a 
frame unft, converts the motion vector to a 
frame unit by a pr e determ in ed approodmation 
method when the motion vector has been 
determined in a field unit, (3) selects only a pre- 
detenmined number of DCT ooefficients (M 
ooeffidenls in a horizDntal dfrection and N coef- 
ficients m a vertical cfirecfion wfiere M and N 
are a natural number from 1 to 8) «4ien DCT 
ooetfidente have been de te r m ine d in a frame 



42. A dKiaal broadcasting si^ storage frjr slonng a 
broadcast connpressed by the Moving Picture so 
Experts Qroup ^PEGi) standard, conrprising: 



a demodulating section to perform a predeter- 
mined demodulation on a digital broadcast 
which is broadcasted by compressing a video 
signal and an audio sigrial by the MPEG stand- 
aid and perfr)rriirig predeteriiAied inultijplex^ 
and modulation on^the video and audto signals; 
a separating section to separate video and 
audto signal compressed streams on a preda- 



unit, and (4) deletes one groip of DCT coeffi- 
dente and selecte only a predetennined 
number of DCT ooelfiGieritB (M ooeffidenls in a 
horizontal dtrection and K coefficients in a ver- 
5 tical cfrection where M and K are a natural 

number from 1 to 8} when DCT coefficients 
haye been determined in a field ifliit; 

a variableHength encoder to perform variable- 
length enoodwig on the selected various flags. 

w motion vectorB^ and DCT ooeff idente by per- 

forming a p re determ in ed flag transfrymation on 

the selected various flags, mofion vectors^ and 

DCT coefficients; 

a mdt^plexHig section to midt^plex the variable- 
16 leng^ encoded video signal date and said 

audio signal conixessed stream; arxt 
a storage secfon to store the multiplexed date 
in a predetennined storage medKfn. 

20 43y An apparatus frx reproducing a video signal and an 
audto signal, oorrprising: 

a reproducing section to reproduce data stored 
in the digital broadcasting signal storage as set 
25 forth in daim 41 or 42; 

a separating section to sepEuate ffie repro- 
duced date irm> video and audto signal com- 
pressed streams; 

a video signal decoding section to decode the 
/ separaied video signal compressed stream; 
and 

an audio signal decoding section to decode the 
separated audio signal compressed stream; 
wherein ffie video signal decoding section has: 
a varictf3le-length decoder to perfrxm vari^e- 
length decodkig on said video signal com- 
pressed siream; 

an inverse quantizer to quantize the variable- 
length decoded data inversely: 
an IDCT unit to perform an inverse M X N or M 
X K DCT (where IM. N, and K are a natural 
nurrber from 1 to 9 on the inversely quantized 
date; 

memory to store the decoded video signal; 
a motion compensator to conpensate motion 
by erTfAyying both a video sigi^ decoded wHh 
a motion vector and a video signal stored in 
said memory; and 

a memory confroHer to confrol wrfting of data to 
so said memory ard reading of date from said 

memory. 

44. A digital broadcasting signal storage for storing a 
broadcast compressed by the Moving Picture 
55 Experts Groip (MPEG) standard, comprising: 

a demoduteting section to peribrm a predeter- 
nvned demodulation on a digital broadcast 
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wWch is broadcasted by conpfBSSing a vi^ 
signal and an aufio signal by the MPEG staml- 
aid and pevforming puNMumined mull|jleDiing 
and modulatxxi on the video and aiidk) signals; 

a separating section to separate video and s 
audio si^ compressed streens on a piede- 
ternined channel by rdeasing said predeter- 
rrined miHlplexing; 

memory to store the sepvated audto signal 
oonpressed stream temporariy; 
a video signal decoding secfon to decode the 
separated video signal conrpressed stream; 
a video signal compression section to com- 
press a video signal which is the nUput of said 
video signal decoding section; is 
a muNjpleBdng section to wMfikoL the video 
signal oonpr e s se d stream compressed at said 
video 8igr»l cornpression section and said 
audio signal conpressed stream; arxi 
a storage section to store the muiliplcMBd data 
In a pre d etermined storage medium; 
wherein said video signal decocfing section 
has: 

a variable-length decoder to perform variirible- 
length deoocing on said video signal com- 26 
pressed stream; 

an inverse quanlizer to quantize the variaUe- 

lengt) decoded data inversely; 
an IDCT unit to perform an inverse DCT on the 
inversely quantized data; so 
memory to store the decoded video signal; 
a motion oonpensator to compensate motion 
by employing both a video agr«d decoded with 
a motion vector and a video signal stored in 
said memory; and ^ 
a memory controller to control writing of data to 
said memory and reading of data from sad 
memory; and 

wherein said video signal oonnpression section 

has: ^ 
a tatering urvt to change resolution of a video 
signal by performing a predetermined fitering 
operation on a reproduced video signal of a 
video signal oonpressed stream during a cfig- 
ital broadcast, the reproduced video signal 46 
being the output of the video signal deoxfng 
section; 

a dNferenlial signal generator to generate a dif- 
ferential sl^ial of the tatered reproduced video 
signal by emplaying said motion vector present so 
in said video signal cornpressed stam wiich 
is the ou^ of said video signal decodvig sec- 
tion; 

a DOT unit to perform DOT on the diterential 
si^ial; S6 
a quantizer to qusitize data after DCT by 
ernpioyng said various flags which are vvNJt to 
the quantizer; a variab toio n gt h encoder to var- 



iaUe-lenglh encode tfte oidput of said quan- 
tizer; and said video signal oonyreseio n 
section outpute a new video signal co m pre ss e d 
stream. 
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VIDEO SIGNAL 
COMPRESSED STREAM 

( MPEG VIDEO STREAM ) 

i 

VARIABLE-LENGTH DECODING 
(DETECTION OF MOTION VECTOR, 
QUANTIZATION STEP, AND DC 
COEFFICIENTS) 

i ^ 

INVERSE QUANTIZATION 
(ONLY DC COEFFICIENTS 
QUANTIZED) 

INVERSE DPCM 

(ONLY DC COEFFICIENTS 

ON WHITCH DPCM HAS BEEN 

PERFORMED) 

MOTION COMPENSATION 
(USE A MOTION VECTOR MULTIPLIED 
BY 1/8 IN HORIZONTAL AND 
VERTICAL DIRECTIONS) 

i 

TEMPORAL STORAGE 
(STORE REPRODUCED VIDEO SIGNALS 
TEMPORARILY AND OUTPUT THEM IN 
DISPLAY ORDER) 

REPRODUCED 
VIDEO SIGNAL 
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VIDEO SIGNAL 
COMPRESSED STREAM 

(MPEG VIDEO STREAM ) 



VARIABLE-LENGTH DECODING 
(DETECTION OF MOTION VECTOR. 
QUANTIZATION STEP, AND MXN 
DCT COEFFICIENTS) 



I 



INVERSE QUANTIZATION 



I 



IDCT 

(MXN COEFFICIENTS) 



I 



MOTION COMPENSATION 
(USE A MOTION VECTOR MULTIPLIED 
BY M/8 IN A HORIZONTAL DIRECTION 
AND N/8 IN A VERTICAL DIRECTION) 



TEMPORAL STORAGE 
(STORE REPRODUCED VIDEO SIGNALS 
TEMPORARILY AND OUTPUT THEM IN 
DISPLAY ORDER) 



REPRODUCED 
VIDEO SIGNAL 
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